AI Evaluation Engineer (QA)

Who We Are

Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom-line impact.

To succeed, organizations must blend digital and human capabilities. Our diverse, global teams bring deep industry and functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate and digital ventures—and business purpose. We work in a uniquely collaborative model across the firm and throughout all levels of the client organization, generating results that allow our clients to thrive.

We Are BCG X
We’re a diverse team of more than 3,000 tech experts united by a drive to make a difference. Working across industries and disciplines, we combine our experience and expertise to tackle the biggest challenges faced by society today. We go beyond what was once thought possible, creating new and innovative solutions to the world’s most complex problems. Leveraging BCG’s global network and partnerships with leading organizations, BCG X provides a stable ecosystem for talent to build game-changing businesses, products, and services from the ground up, all while growing their career. Together, we strive to create solutions that will positively impact the lives of millions.

What You'll Do

Our BCG X teams own the full analytics value-chain end to end: framing new business challenges, designing innovative algorithms, implementing, and deploying scalable solutions, and enabling colleagues and clients to fully embrace AI. Our product offerings span from fully custom-builds to industry specific leading edge AI software solutions.

As a Forward Deployed AI Engineer you’ll be part of our rapidly growing engineering team and help to build the next generation of AI solutions. You’ll have the chance to partner with clients in a variety of BCG regions and industries, and on key topics like climate change, enabling them to design, build, and deploy new and innovative solutions. Additional responsibilities will include developing and delivering thought leadership in scientific communities and papers as well as leading conferences on behalf of BCG X.

We Are Looking For Talented Individuals With a Passion For Software Development, Large-scale Data Analytics And Transforming Organizations Into AI Led Innovative Companies. Successful Candidates Possess The Following

• Apply software development practices and standards to develop robust and maintainable software
• Actively involved in every part of the software development life cycle
• Experienced at guiding non-technical teams and consultants in and best practices for robust software development
• Optimize and enhance computational efficiency of algorithms and software design
• Motivated by a fast-paced, service-oriented environment and interacting directly with clients on new features for future product releases
• Enjoy collaborating in teams to share software design and solution ideas
• A natural problem-solver and intellectually curious across a breadth of industries and topics

What You'll Bring

Technologies
Programming Languages: Python

Please note: any degree programs (including part-time) must be completed before starting at BCG.

Additional info

You must live within a reasonable commuting distance of your home office. As a member of that office, it is expected you will be in the office as directed. This role puts you on an accelerated path of personal and professional growth and development and so, at times, requires extended working hours. Our work often requires travel to client sites.

Boston Consulting Group is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable, and those with criminal histories will be considered in a manner consistent with applicable state and local laws.

BCG is an E - Verify Employer. Click here for more information on E-Verify.

Data Science Expert – AI Content Specialist
About The Role
What if your deep expertise in machine learning and statistics could directly shape how the world's most advanced AI systems think and reason? We're looking for Data Science Experts to stress-test, audit, and train frontier AI models — exposing gaps in their reasoning and building the gold-standard solutions that make them smarter.

This is a fully remote, flexible contract role designed for experienced data scientists, researchers, and quantitative specialists who want to do meaningful, intellectually engaging work on their own terms.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10–40 hours/week

What You'll Do

• Design Advanced Challenges — Create complex, domain-spanning data science problems covering areas like hyperparameter optimization, Bayesian inference, cross-validation strategies, and dimensionality reduction to probe the limits of AI reasoning
• Author Ground-Truth Solutions — Develop rigorous, step-by-step technical solutions including Python/R scripts, SQL queries, and mathematical derivations that serve as definitive reference answers
• Audit AI-Generated Code — Critically evaluate AI outputs involving libraries like Scikit-Learn, PyTorch, and TensorFlow, assessing for correctness, efficiency, and best practices
• Identify and Fix Reasoning Failures — Spot logical flaws in AI reasoning — such as data leakage, overfitting, or improper handling of imbalanced datasets — and provide structured feedback that improves model behavior
• Work Independently — Take ownership of your tasks asynchronously, delivering high-quality work on a schedule that suits you

Who You Are

• Hold or are pursuing a Master's or PhD in Data Science, Statistics, Computer Science, or a related quantitative field
• Strong foundational knowledge across core data science areas: supervised/unsupervised learning, deep learning, statistical inference, big data technologies (Spark, Hadoop), or NLP
• Able to communicate complex algorithmic and statistical concepts clearly and precisely in writing
• Meticulous attention to detail — you catch errors in code syntax, mathematical notation, and statistical conclusions
• No prior AI or annotation experience required

Nice to Have

• Experience with data annotation, data quality assurance, or model evaluation workflows
• Familiarity with production-level data science practices such as MLOps or CI/CD for machine learning models
• Background in academic research or technical writing

Why Join Us

• Work directly with industry-leading AI models and cutting-edge research teams
• Fully remote and asynchronous — work when and where you're most productive
• Freelance autonomy with the structure of meaningful, intellectually stimulating work
• High-impact contribution: your expertise shapes how AI reasons about data science for users worldwide
• Potential for ongoing work and contract extension as new projects launch

Netflix is one of the world's leading entertainment services, with over 300 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time.

The Content Data Science and Engineering (DSE) team is passionate about storytelling and bringing our members joy. Our mission to entertain the world is anchored in our content, and data is a crucial component in shaping our comprehensive content strategy. We focus on creating analytical products that support our Content partners in their complex and nuanced decision-making processes. We are a highly collaborative team that partners across Netflix to drive impact.

We are seeking a talented Senior Data Scientist to provide key insights to our Content decision makers in LatAm. You will generate insights by scoping and executing deep dive analysis with local partner analytics teams, Consumer Insights, and Finance & Strategy. In success, you will collaborate on existing priorities but also will propose and execute on new opportunities. This role features ample opportunity for project ownership and will support impactful decision-making, across existing content initiatives and novel ones.

In This Role You Will

• Be a strategic thought partner with business stakeholders to define high impact analytical problems and innovative ways to solve them with data.
• Develop statistical models explaining viewership, content engagement, and other key behavioral patterns.
• Build dashboards and visualization that enables stakeholders to self-serve metrics and trends effectively.
• Actively socialize and educate, aiding on interpretation.
• Translate analytic insights into actionable recommendations for business or content improvement, and communicate these findings clearly to a broad audience.
• Identify and proactively socialize regional insights, including those that may generalize to opportunities in other markets.

What You Will Bring

• Exceptional interpersonal and communication skills to influence stakeholders using clear insights and recommendations.
• Exceptional thought partnership to build credibility and relationships with stakeholders.
• Strong statistical knowledge: understanding of predictive modeling; ability to tease out incrementality vs. correlations, confounder identification and amelioration, etc.
• Basic understanding of experimentation inclu,ding power calculations and interpretation of results.
• Strong SQL skills and experience with distributed analytic processing technologies (S3, Presto, Hive, & Spark).
• Strong skills in Python or R.
• Highly effective in engaging with diverse stakeholders and adept at cultivating strong partnerships.
• Passionate about communicating difficult concepts to non-technical audiences.
• Self-starter who thrives under a high level of autonomy.
• Exceptional interpersonal and communication skills.
• Enthusiastic about Netflix culture.

Inclusion is a Netflix value and we strive to host a meaningful interview experience for all candidates. If you want an accommodation/adjustment for a disability or any other reason during the hiring process, please send a request to your recruiting partner.

We are an equal-opportunity employer and celebrate diversity, recognizing that diversity builds stronger teams. We approach diversity and inclusion seriously and thoughtfully. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.

Data Scientist (Masters) — AI Data Trainer
About The Role
What if your expertise in machine learning, statistical inference, and data engineering could directly shape how the world's most advanced AI models think and reason? We're looking for data scientists with graduate-level training to challenge, audit, and refine cutting-edge AI systems — exposing their blind spots and helping build models that are sharper, more rigorous, and genuinely trustworthy.

This is a fully remote, flexible contract role. No prior AI industry experience required — just deep domain knowledge and a passion for getting things right.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10–40 hours/week

What You'll Do

• Design Complex Challenges: Craft advanced data science problems spanning hyperparameter optimization, Bayesian inference, cross-validation strategies, dimensionality reduction, and more — pushing AI models to their limits
• Author Ground-Truth Solutions: Develop rigorous, step-by-step technical solutions including Python/R scripts, SQL queries, and mathematical derivations that serve as the benchmark for AI responses
• Audit AI-Generated Code: Evaluate AI outputs using libraries like Scikit-Learn, PyTorch, and TensorFlow — assessing technical accuracy, efficiency, and best practices
• Refine AI Reasoning: Identify and document logical failures such as data leakage, overfitting, and improper handling of imbalanced datasets, then provide structured feedback that improves how models reason through problems

Who You Are

• Currently pursuing or holding a Master's or PhD in Data Science, Statistics, Computer Science, or a quantitative field with a strong data analysis focus
• Solid foundational knowledge across supervised and unsupervised learning, deep learning, big data technologies (Spark/Hadoop), or NLP
• Able to communicate complex algorithmic and statistical concepts clearly and precisely in writing
• Naturally meticulous — you catch errors in code syntax, mathematical notation, and statistical conclusions that others miss
• No prior AI or data annotation experience required

Nice to Have

• Experience with data annotation, data quality pipelines, or evaluation systems
• Familiarity with production-level data science workflows — MLOps, CI/CD for models, model monitoring
• Hands-on experience with experiment tracking tools (e.g., MLflow, Weights & Biases)

Why Join Us

• Work directly with industry-leading AI research labs on frontier models
• Fully remote and asynchronous — work when and where it suits you
• Flexible contractor arrangement with high autonomy and global reach
• Apply your graduate-level expertise to work that has real, measurable impact on AI development
• Potential for ongoing contracts and expanded project access as new work launches