Transforming Agricultural Data with AI

Six Feet Up leveraged the power of AI and Large Language Models (LLMs) to develop an intuitive chat interface, streamlining the process of accessing Beck's farming research. The system, despite its seemingly simple user interface, comprised three main subsystems:

1. Data Gathering Framework: This subsystem was engineered to locate and break down documents into a more usable format. The framework extracted data from numerous PDFs residing on Beck's intranet, overcoming the challenge of decoding research papers laid out like brochures.
2. AI Framework: The core of the solution, this framework incorporated AI models from OpenAI, LangChain, and Llama Index. Each model was fine-tuned and tested rigorously to ensure it delivered accurate, relevant answers.
3. Layering Framework: This layer effectively integrated Beck's research into the AI models, transforming the data into a format that the "bots" could understand and learn from.

The project was managed using Python — the 'lingua franca of AI.' This language allowed for faster iteration of ideas. Django was used for the backend, while HTMX was used for the UI. For deployment, the team used Kubernetes, simulating a cloud environment on their machine. This approach made it easy to replicate the setup in different environments.

Throughout the development, the Six Feet Up team tackled challenges related to rapidly evolving libraries, and sub-dependency conflicts in this ever-evolving area. They managed these obstacles by locking down every aspect of a working system until new requirements emerged.

The final deliverable was hosted on Beck's own hardware to ensure security. In addition, assurances were sought from OpenAI to ensure they wouldn't retain or learn from Beck's proprietary information.