Senior Director, Data & ML Architecture
ELLKAY
Software Engineering, IT, Sales & Business Development, Data Science
United States
ELLKAY started out providing connectivity solutions to laboratories and within a few years, grew to also provide data management solutions to ambulatory organizations. ELLKAY is now a trusted data management partner in five healthcare segments. ELLKAY’s solutions continue to serve laboratories and ambulatory practices and have expanded to empower hospitals and health systems, healthcare IT vendors, ambulatory practices, health plans, and other healthcare organizations with cutting-edge technologies and solutions that drive their growth and interoperability strategies.
Today, ELLKAY remains true to our core values, building strong partner relationships and offering unparalleled service and support while providing innovative, scalable solutions to the challenges our customers face in today’s data-rich world.
ELLKAY's experience, customer-focused approach, and reputation for innovation, speed, and accuracy differentiate ELLKAY as a premier partner for your interoperability needs and data management strategy.
Job Description:
Senior Director of Data and AI/ML Architecture is the technical leader responsible for designing and guiding the end-to-end architecture of data & machine learning systems across the enterprise. This role focuses on building scalable, reliable, and secure AI platforms, services, and patterns that power core products and internal decisioning
Essential Duties & Responsibilities:
- Define and maintain the technical architecture for AI systems, including model development, training, inference, and monitoring.
- Design reference architectures and reusable components for LLMs, agentic AI, recommendation systems, and predictive models.
- Partner with data engineering, product, and platform teams to translate business requirements into AI solutions and services.
- Establish standards for model lifecycle management, including feature stores, MLOps, CI/CD for ML, and experiment tracking.
- Collaborate with security, compliance, and legal teams to ensure responsible, secure, and compliant AI usage.
- Provide technical leadership and mentorship to AI/ML engineers, data scientists, and platform engineers.
- Evaluate emerging AI technologies, frameworks, and tools, and drive their adoption where appropriate.
- Create technical documentation, architectural guidelines, and decision records to ensure alignment and reusability.
Qualifications:
- 10+ years of experience in software engineering, data engineering, or AI/ML, with 5+ years focused on AI system design.
- Hands-on expertise with modern ML Engineering stack (e.g., Sagemaker, Spark, Kubernetes, feature stores, vector databases).
- Proven experience architecting large-scale AI platforms and production ML systems (training and low-latency inference).
- Strong understanding of MLOps practices, observability, and reliability for AI workloads.
- Ability to communicate complex technical concepts to technical and non-technical stakeholders.
- Bachelor’s or Master’s in Computer Science, Engineering, Data Science, or related field (or equivalent experience).
Benefits:
ELLKAY offers a comprehensive and competitive benefit package that starts day one!
Including:
- Medical, Dental, and Vision benefits
- Employer-paid Life and LTD
- 401k w/ matching – once eligibility is met
- Work/life balance
- Paid Volunteer Program
- Flexible working hours
- Generous FTO
- Remote work options
- Employee Discounts
- Parental Leave
Our awesome culture includes:
- Working with talented, collaborative, and friendly people who love what they do
- Professional growth within
- Innovation environment
- On site in HQ Free daily lunches
Additional information
At ELLKAY, we are committed to operating as a hybrid workplace, offering employees flexibility in how they structure their time between in-office and remote work. We recognize the significance of fostering connections, collaboration, and creativity within our office culture and its positive impact on our business. Our philosophy of operating as a hybrid workplace underscores our dedication to enabling employees to tailor work-life balance to their individual preferences. For those who do not live within 40 miles of one of our offices, we are open to considering remote work for candidates whose skills and experience strongly align with the role. While we prioritize a hybrid work environment for most roles, we understand the importance of flexibility and are open to remote work for specific positions and specialized skill sets.
For more information on our company, visit www.ELLKAY.com.
ELLKAY LLC is a Smoke-Free Workplace.
ELLKAY, LLC provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.