Configuring MySQL as a Source
In the Sources tab, click on the “Add source” button located on the top right of your screen. Then, select the MySQL option from the list of connectors. Click Next and you’ll be prompted to add your access.1. Add account access
Check MySQL’s documentation to discover where you can find the required parameters for the connection. Provide the necessary credentials and connection details to allow Nekt to access your database. Once you’re done, click Next.2. Select streams
Choose which tables (streams) you want to sync. For faster extractions, select only the tables that are relevant to your analysis. You can select entire groups of tables or pick specific ones.Tip: The stream can be found more easily by typing its name.Select the streams and click Next.
3. Configure data streams
Customize how you want your data to appear in your catalog. Select the desired layer where the data will be placed, a folder to organize it inside the layer, a name for each table (which will effectively contain the fetched data) and the type of sync.- Layer: choose between the existing layers on your catalog. This is where you will find your new extracted tables as the extraction runs successfully. (Note: companies in the Growth plan can choose in which layer the tables will be placed).
- Folder: a folder can be created inside the selected layer to group all tables being created from this new data source.
- Table name: we suggest a name, but feel free to customize it. You have the option to add a prefix to all tables at once and make this process faster!
- Sync Type: you can choose between INCREMENTAL and FULL_TABLE.
- Incremental: every time the extraction happens, we’ll get only the new data - which is good if, for example, you want to keep every record ever fetched.
- Full table: every time the extraction happens, we’ll get the current state of the data - which is good if, for example, you don’t want to have deleted data in your catalog.
4. Configure data source
Describe your data source for easy identification within your organization, not exceeding 140 characters. To define your Trigger, consider how often you want data to be extracted from this source. This decision usually depends on how frequently you need the new table data updated (every day, once a week, or only at specific times). Optionally, you can define some additional settings:- Configure Delta Log Retention and determine for how long we should store old states of this table as it gets updated. Read more about this resource here.
- Determine when to execute an Additional Full Sync. This will complement the incremental data extractions, ensuring that your data is completely synchronized with your source every once in a while.
- Max batch size for parquet files: (Default:
100000) Available under advanced settings, this determines the maximum batch size for target S3 parquet files.
5. Check your new source
You can view your new source on the Sources page. If needed, manually trigger the source extraction by clicking on the arrow button. Once executed, your data will appear in your Catalog.Streams and Fields
Since MySQL is a relational database, the available streams and fields will correspond exactly to the tables, views, and columns present in your specific database schema. Each selected table will be replicated as a stream, and its columns will map to the fields within that stream.Skills for agents
Download MySQL skills file
MySQL connector documentation as plain markdown, for use in AI agent contexts.