AI Data Engineer

About this role

Schonfeld Strategic Advisors is looking for an AI Data Engineer to enhance their AI infrastructure by developing data pipelines and ensuring high-quality data flow for their internal AI platform, SchonAI. This role combines data engineering and AI, requiring collaboration with various internal teams to support investment practices.

What you'll do

• Design and implement scalable data pipelines using Prefect.
• Develop ETL/ELT processes for diverse data sources.
• Build and maintain AI/ML optimized data infrastructure.
• Collaborate with AI engineers and data scientists to define data requirements.
• Enforce data governance and security measures.
• Monitor and optimize pipeline performance.

What they're looking for

• Proficient in Python and SQL.
• 5+ years of experience in data engineering.
• Familiar with big data technologies like Spark.
• Experience in AWS or GCP services.
• Knowledge of both SQL and NoSQL databases.
• Understanding of AI/ML data needs.
• Skills in data streaming technologies.
• Experience with data quality frameworks.

Benefits

• [unknown]
• [unknown]
• [unknown]
• [unknown]
• [unknown]
• [unknown]