Research Intern Generative AI for Multimodal Interactions

at Intel in Oklahoma City, Oklahoma, United States

Job Description

Job Description

Intelligent Systems Research Lab (ISR) is focused on multi-disciplinary research spanning ethnography, design, HCI, and AI to create Human/AI collaborative systems that can amplify human potential and create sustainable and transparent AI solutions. We utilize multi-modal signals (e.g. vision, audio, speech, language, RF) and AI to infer and predict human state and actions and enable physically situated dialog and interactions. We conduct this research in the context of vertical domains including manufacturing, education, enterprise, and assistive computing for people with disabilities.

ISR is looking for an Intern passionate about building novel Multimodal Interaction Agents. This work will involve developing efficient multimodal architectures and pipelines for vision/language interaction systems for real-time task guidance support, in particular (but not limited to) manufacturing domain.

In this context, the intern will be able to explore methods to improve LLM-based Retrieval-based pipelines from complex metadata in documents (e.g., free form text, tables and figures), prompting approaches (e.g., ReAct, multimodal-react, thought-prompting etc.) and conversational Human/Assistant dialogues to generate responses that are factually correct and may involve multi-step reasoning.

You will be building and evaluating systems and proofs-of-concept that will allow for the deployment of scalable approaches in real settings. This research will enable validation of the ideas and the publication of findings in both internal and external venues.

This is an internship position and compensation will be given accordingly.


You must possess the below requirements to be initially considered for this position. Preferred qualifications are in addition to the requirements and are considered a plus factor in identifying top candidates. Experience listed below would be obtained through a combination of your schoolwork and/or classes and/or research and/or relevant previous job and/or internship experiences.

Minimum Qualifications :

The candidate must be pursuing a PhD degree in Electrical Engineering, Computer Engineering, Electrical & Computer Engineering, Computer Science or in related field with ML/AI focus.

1+ year experience in below areas:

+ Deep Learning, i.e. Computer Vision and/or Natural Language Processing

+ AI frameworks (e.g. PyTorch, TensorFlow)

+ Python and C++ languages, and Linux OS

Preferred Qualifications:

+ 1+ year experience in Vision-Language Systems and RAG pipelines.

+ Knowledge of novel paradigms beyond supervised learning, such as weakly supervised multimodal reasoning, Human in the loop approach, uncertainty, and anomaly detection

+ 1+ year experience with NLP techniques such as natural language understanding, semantic role labeling, information extraction

+ Familiarity with Intel OpenVino and RealSense technologies

+ Familiarity with ROS (Robotic Operating System)

+ Publications in top-tier conferences and journals in machine learning related fields (NeurIPS, ICML, AAAI, ACL, etc.)

Inside this Business Group

Intel Labs is the company’s world-class, industry leading research organization, responsible for driving Intel’s technology pipeline and creating new opportunities. The mission of Intel Labs is to deliver breakthrough technologies to fuel Intel’s growth. This includes identifying and exploring compelling new technologies and high risk opportunities ahead of business unit investment and demonstrating first-to-market technologies and innovative new usages for computing technology. Intel Labs engages the leading thinkers in academia and industry in addition to partnering closely with Intel business units.

Posting Statement

All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.


We offer a total compensation package that ranks among the best in the industry. It consists of competitive pay, stock, bonuses, as well as, benefit programs which include health, retirement, and vacation. Find more information about all of our Amazing Benefits here. (

Annual Salary Range for jobs which could be performed in US, Colorado, New York, Washington, California: $63,000.00-$166,000.00

*Salary range dependent on a number of factors including location and experience

Working Model

This role is available as a fully home-based and generally would require you to attend Intel sites only occasionally based on business need. This role may also be available as our hybrid work model which allows employees to split their time between working on-site at their assigned Intel site and off-site. In certain circumstances the work model may change to accommodate business needs.

To view full details and how to apply, please login or create a Job Seeker account
How to Apply Copy Link

Job Posting: JC257851829

Posted On: Apr 04, 2024

Updated On: Jun 25, 2024

Please Wait ...