Agentic Data Engineer Job at Acrostaff, Cordova, NC

c2RaTjJpTWhLWkZQMjFyMnRaNGRjejZPWEE9PQ==
  • Acrostaff
  • Cordova, NC

Job Description

Role: VDOT - Agentic Data Engineer JOB ID - (759501) / AI Data Engineer with AzureLocation: 1401 E Broad St Richmond, VA 23219 - HybridInterview Type: Both Phone and In Person Interview Description:- Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problemsThe Virginia Department of Transportation's Information Technology Division is seeking a highly skilled Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems. The ideal candidate will have experience in designing data process to support agentic systems, ensure data quality and facilitating interaction between agents and data.    Responsibilities:  Designing and developing data pipelines for agentic systems, develop Robust data flows to handle complex interactions between AI agents and Data sources. Ability to train and fine tune large language models Design and build the data architecture, including databases, data lakes to support various data engineering tasks. Develop and manage Extract, Load, transform (ELT) processes to ensure data is accurately and efficiently moved from source systems to analytical platforms used in data science. Implement data pipelines that facilitate feedback loops, allowing human input to improve system performance in human-in-the-loop systems. Work with vector databases to store and retrieve embeddings efficiently. Collaborate with data scientists and engineers to preprocess data, train models, and integrate AI into applications. Optimize data storage and retrieval with high performance Statistical analysis, trends, patterns to create data formats from multiple sources. Qualifications:           Strong Data engineering fundamentals Utilize Big data frameworks like Spark/Databricks Training LLMs with structed and unstructured data sets. Understanding of Graph DB Experience with Azure Blob Storage, Azure Data Lakes, Azure Databricks Experience implementing Azure Machine Learning, Azure Computer Vision, Azure Video Indexer, Azure OpenAI models, Azure Media Services, Azure AI Search  Determine effective data partitioning criteria Utilize data storage system spark to implement partition schemes Understanding core machine learning concepts and algorithms Familiarity with Cloud computing skills Strong programming skills in Python and experience with AI/ML frameworks. Proficiency in vector databases and embedding models for retrieval tasks. Expertise in integrating with AI agent frameworks. Experience with cloud AI services (Azure AI). Experience with GIS spatial data to create markers on maps ( lat long nearest topology of road, geo-locate between datasets, correlation etc.). Experience with Department of Transportation Data Domains developing an AI Composite Agentic Solution designed to identify and analyze data models, connect & correlate information to validate hypotheses, forecast, predict and recommend potential strategies and conduct What-if analysis. Bachelor's or master's degree in computer science, AI, Data Science, or a related field.

Job Tags

Similar Jobs

Sarepta

Chief U.S. Regulatory Counsel & Chief Compliance Officer Job at Sarepta

 ...list of our comprehensive benefits, see our website: The Importance of the Role The Vice President, Chief U.S. Regulatory Counsel & Chief Compliance Officer is responsible for providing regulatory and commercialization legal support, advice, and counsel in... 

G-3 Chickadee

Analytical Chemist Job at G-3 Chickadee

 ..., plant chemists, and quality teams to ensure continuity of operations. What You Bring Required ~ Masters in Analytical Chemistry, Organic Chemistry, Physical Chemistry, or a closely related discipline with at least 7 years' experience Preferred Ph.D... 

Weston Solutions

Construction Superintendent III Job at Weston Solutions

 ...sustainable future.Weston Solutions, Inc. is seeking a Superintendent to support our construction program. The Superintendent will be responsible for...  ...construction completion and customer satisfaction. Up to 80% travel throughout the U.S. will be required for this position.... 

NavitsPartners

Licensed Master Social Worker (LMSW) - 26-05025 Job at NavitsPartners

 ...Job Title: Licensed Master Social Worker (LMSW) Profession: Social Services Specialty: LMSW (Licensed Master Social Worker) Job Location: New York, NY Shift Details: Day Shift (3x8-hour schedule) with variable timings: Monday: 9:30 AM... 

Sysco

Warehouse Order Selector Job at Sysco

 ...please visit JOB SUMMARY: Under general supervision, the associate will accurately and efficiently select products in the warehouse. Prepare products for shipping by stacking in an orderly and stable configuration, while maintaining a clean and safe work environment...