How Modern LLMs Are Redefining User Interfaces

Meet Talos: DataForge's Virtual AI Assistant, powered by advanced large language models (LLMs). Talos brings a new level of efficiency and intuitiveness to data management. Here’s what Talos can do for you:

• Identify existing connections by name

• List available external source database schemas within a remote connection

• Locate tables within a connection - with optional filtering by schema and table name

• Create new sources from tables - with optional data extraction and provide a link to open the source and view the data

• Find existing DataForge Cloud sources by name or table name - and provide a link to open them

• Search for attributes (raw, rule, or output columns) by name, type, and container name, and provide a link to view the full lineage screen for the attribute

Many of these tasks can also be accomplished using the standard DataForge Cloud UI, but Talos offers a more intuitive alternative. Notably, finding attributes and displaying lineage, previously only possible through metastore database queries, is now easily handled by Talos - showcasing the unique advantage of an LLM-powered tool.

Future Enhancements

We have exciting plans to expand Talos's capabilities. Here are a few areas we're considering for future releases:

• DataForge Online Help Integration: "Explain the concept of relation and relation types"

• Operational Status Queries: "Summarize failed processes by source in project X since last Friday"

• AI-Augmented Configuration Assistance: "Create a new connection from PostgreSQL" or "Add a rule to source X to calculate Y"

DataForge focuses on features that fully utilize LLMs' natural language processing capabilities, aiming to enhance the user experience for both new and experienced DataForge users.

As always, we look forward to your feedback. Let’s shape the future of data engineering together! 🚀