- Create your Nekt account
- Set up your cloud environment (AWS or GCP)
Feel free to watch the video tutorial below for a visual walkthrough, or follow the step-by-step instructions right after it.
Step 1: Create your account
- Go to
https://app.nekt.ai/signupand enter your first name, last name, and email (preferably your company email). Click Continue. - Follow the instructions on your email to verify your account. You’ll need to define your password at this point.
- Log in with the email and password you just created.
Step 2: Create the company workspace
- Add your company logo.
- Enter your company name, size, country, and timezone. Click Continue.
Step 3: Set up your cloud environment
Currently, we have full support for AWS and GCP.AWS Setup
AWS Setup
-
To run your workspace with AWS, we need to create a stack with all the necessary resources. Before we do that, make sure your AWS account meets the following requirements:
- You have an active paid AWS account
- No previous Nekt workspace exists in this AWS account. If you’ve gone through this process before, delete any related stack to avoid conflicts.
- Select the AWS region for your Nekt workspace. If unsure, keep the default value — it’s our recommendation for the most cost-effective option. Click Continue.
- Click Open AWS CloudFormation to be redirected to AWS. This will open a new tab on the CloudFormation console with the Nekt stack. For more information on the resources that will be created, check the section below.
List of AWS Resources
List of AWS Resources
The CloudFormation stack provisions the following resources in your AWS environment:
Core Infrastructure
-
IAM Roles & Permissions
- ECS Service Roles: Enable source and destination connectors to access data and store it in S3
- EMR Service Roles: Allow sources and transformations to access your data catalog and perform data operations
- Frontend Access Role: Enables data preview and exploration through the Nekt application
- Server Orchestration Role: Allows Nekt to manage and coordinate all sources, destinations, and transformations
-
Lambda Functions
Custom functions that handle CloudFormation deployment tasks, including VPC IP retrieval, resource identifier notifications, and deployment completion notifications. -
Networking Infrastructure
An isolated VPC with secure network architecture:- 1 public subnet and 2 private subnets
- NAT instance with Elastic IP for secure outbound connectivity
- Internet gateway for public subnet access
- Security groups configured for each resource type
-
Data Storage & Catalog
- S3 Bucket: Secure storage location for all your data
- AWS Glue Databases: Managed data catalog that integrates with Nekt’s platform for metadata management
-
Container & Processing Infrastructure
- ECR Repository: Private Docker registry for custom connector and transformation images
- EMR Studio: Spark processing environment for data transformations and analysis
- ECS Cluster: Container orchestration platform for running connectors
On-Demand Resources
The following resources are provisioned automatically when you run data operations:-
AWS Fargate Tasks
Serverless container execution for source and destination connectors -
EMR Application Jobs
Spark-based processing jobs for data sources and transformations -
Amazon Athena
Interactive query service used when exploring data through Nekt’s interface
Note: The workspace setup process is automated, so you don’t need to manually configure any resources beyond running the stack.
- Keep the pre-filled default values for the stack resources.
- Scroll down and check all checkboxes at the end of the page to allow the resources to be created.
- Click Create stack to start the creation process - this entire process should take less than 5 minutes.
- Click the refresh button to reload the page and check the status. When the stack creation process is completed, you’ll see the stack status change from CREATE_IN_PROGRESS to CREATE_COMPLETE.
- Go back to the Nekt app and you’ll be automatically redirected to the Set up your profile page.
GCP Setup
GCP Setup
Documentation coming soon.
Step 4: Set up your profile
- Add your profile picture.
- Review your name and email information. Click Continue.
- Enter the current role you have at your company.
- You’ll be redirected to the Nekt Overview page.
Now, your workspace is ready! 🚀🚀 ➡️ Move on to the next page of this guide to learn how to Invite team members.
Troubleshooting
-
A few actions (like creating sources for example) might not work if your AWS Quotas are too low, specially if you have a new AWS account. Please check if you have at least 16 applied quotas on EMR Serverless service and request an increase if necessary.
- Here’s the AWS official guideline for doing so. We also demonstrate the process on the video below.
You don’t need to increase the Fargate quotas as shown on the video unless explicitly requested.
If you encounter any issues during onboarding or need assistance, feel free to reach out to our support team. We’re here to help you get started.
-
If AWS takes too long to reply to your support request to increase your quotas, you can try reaching out to them via live chat, following the steps in the video below.
We’re setting up a product called Nekt (nekt.com), which builds a Lakehouse on AWS for us, and to process data they use mostly EMR Serverless. The increase to at least 16vCPU is crucial to unblock my team from moving on with our data projects.