Make Appointment

Agentic Robot

HR & Technology

Agentic Robot

AI-powered robotic simulation system integrating Unity, ROS2, and OpenAI to create an intelligent Niryo One robotic arm capable of autonomous task execution based on natural language commands through a Streamlit interface.

View on GitHub
Agentic Robot
About This Project

What This Software Does

This AI-powered robotic simulation system integrates Unity 3D game engine, ROS2 robotics middleware, and OpenAI natural language processing to create an intelligent Niryo One robotic arm capable of autonomous task execution. The system features a Unity-based simulation environment, ROS2 integration for communication between Unity and Python components, and an OpenAI-powered agent that interprets natural language commands with contextual awareness.
Users interact with the robot through a Streamlit web interface providing real-time visualization and control. The agentic workflow dynamically interprets user commands and maintains context across sequential operations, enabling complex multi-step tasks to be executed through simple conversational instructions. The system runs on Ubuntu 22.04 LTS with Unity 6000.0.28f1 and ROS2 Iron providing a complete simulation-to-execution pipeline.
The architecture consists of a Unity simulation environment for physics-accurate robotic arm behavior, ROS2 TCP endpoint for message passing between components, a Python-based AI agent for command interpretation and trajectory planning, and a Streamlit dashboard for user interaction. This enables researchers and developers to test robotic behaviors in simulation before deploying to physical hardware.

CAPABILITIES

Key Features

Powerful features that make this solution stand out

Unity 3D Simulation Environment

Physics-accurate simulation of Niryo One robotic arm in Unity 6000.0.28f1 providing realistic joint dynamics, collision detection, and visualization for safe testing before hardware deployment.

ROS2 Middleware Integration

ROS2 Iron integration enabling standardized communication between Unity simulation and Python control components with TCP endpoint for reliable message passing and topic-based architecture.

OpenAI-Powered Natural Language Control

AI agent interprets natural language commands using OpenAI API to dynamically generate robot trajectories and action sequences without requiring low-level programming or trajectory specification.

Streamlit Real-Time Interface

Web-based Streamlit dashboard providing real-time robot state visualization, command input, and execution monitoring accessible through browser at localhost:8501 for remote operation capability.

Contextual Agentic Workflow

Intelligent agent maintains conversation context across multi-step operations enabling complex task sequences through conversational instructions with dynamic planning and error recovery.

Complete Simulation-to-Execution Pipeline

End-to-end system from user command through AI interpretation, Unity simulation, and ROS2 control with organized repository structure separating robot agent, Unity project, and ROS2 workspace.

TECH STACK

Built With Modern Technologies

Unity ROS2 Python OpenAI Streamlit Ubuntu C#
TRY IT OUT

Experience It Yourself

GitHub Repository

View source code
GET A QUOTE

Interested in This Solution?

Get a customized quote for your business needs

Enquiring about: Agentic Robot