Researcher & Senior RL Engineer Articulated Robots RL Hybrid Methods Sim-to-Real Motion Imitation
I build control for articulated robots — from novel actuators to legged locomotion, reinforcement learning, whole-body control, and sim-to-real deployment. Currently exploring generative motion planners stacked on unified whole-body controllers.
M.Sc. — Korea University of Technology and Education · STANKIN
simkaned@gmail.com · simeon-ned.github.io · GitHub · X · Google Scholar
Humanoid RL & WBC · industry + research · sim-to-real on real hardware
| 2026–now |
Senior RL Engineer · MIPT Humanoid RL, WBC, generative motion research |
| 2023–2026 |
Senior RL Engineer · Sber Robotics Green humanoid — predictor-based locomotion, WBC, teleop, actuator sys ID, sim-to-real (AIJ 2025) |
| 2022–now |
Senior Lecturer · Innopolis University Robotics, nonlinear control, simulation |
| 2019–2023 |
Researcher · Innopolis University Novel actuators, adaptive control, hardware prototyping |
| 2017–2019 |
Research Assistant · BioRobotics Lab, Korea Mechanical design, embedded control, robot prototyping |
~9 yrs robotics · ~4–5 yrs RL/DL · 3+ yrs locomotion & WBC in production & research
Reactive Generative Motion Planner for Unified WBC
Fast, task-general Gen → trackable WBC references every step above a frozen controller.
Latent flow matching trained from streaming WBC rollouts with domain randomisation — reactive, physics-aware and controller-aware generation, not open-loop kinematic playback. Generalizable across tasks under one unified WBC contract; recovery and get-ups from failed states are embedded in the planner ((sim: autonomous recovery & get-up), with no fall/stand mode FSM. On G1 CPU (no Jetson): walk / sprint teleop, disturbance rejection, and agile recovery. Try Gen alongside WBC tracking to interactively generate robot locomotion (WASD to steer, Shift to sprint; G switches clips ↔ Gen). Training code and paper coming soon.
Whole Body Control in MuJoCo Lab
One shared MDP → train once, deploy one policy for many whole-body skills.
Modular mjlab stack — shared MDP in env/, registered robot entities, presets that compose tasks without forking core code. Multi-clip motion tracking with BeyondMimic / ZEST / SONIC-style task presets.
--task on one CLI & log layoutregister_wbc_extensionpolicy.onnx + config.yaml for deploy runtimespolicy.onnx + config.yaml deploy export · open-source frameworkProject page · Demo · Code · Docs
Predictive Style Matching for Natural Locomotion
Predictive Style Matching — natural gait without imitation fragility on Unitree G1 (sim & hardware).
Task-only RL transfers and recovers well, but gaits stay stiff; clip tracking looks more natural yet references fight the balance controller — about 5× more falls under pushes. A frozen predictor fφ maps lower-body history and commands to state-conditioned upper-body and gait targets; matching rewards are used only at training time — the deployed πθ keeps vanilla proprioceptive observations.
RL Locomotion & Whole-Body Control
Senior engineer — RL locomotion & WBC on the Green humanoid (AIJ 2025).
Predictor-based human-like locomotion; unified WBC for teleoperation, dance, and zero-shot skills; synthetic references without mocap retargeting; motor and actuator system identification for simulation fidelity.
Batched Differential IK on MuJoCo Warp
GPU-parallel IK on MuJoCo Warp — author, PyPI package.
Mink-shaped API for batched task-space IK: closed chains, hard limits via GPU ADMM, CUDA graphs for real-time loops.
Dynamics · system ID · differential IK · retargeting · GPU-accelerated control
EqualityConstraintTask for closed chains
Why this work · what I bring · where I'd take it next
The synergy of interesting problems that are practical and research-worthy at once — pushing what robots can execute, from agile locomotion and whole-body motion to generative motion planning beyond fixed gaits, with research and production moving together.
Industry + research on learning-based control. At Sber Robotics: core senior RL engineering — predictor-based locomotion, WBC, actuator sys ID, MuJoCo pipelines to deployable policies. Research & teaching: WBC and generative motion planning.
Happy to discuss humanoid RL, WBC, and sim-to-real for your team.
simkaned@gmail.com · Telegram · simeon-ned.github.io · X · CV
Questions?