Francisco Giral (@fa_giral) profile picture

PhD Student at Technical University of Madrid (UPM) | Reinforcement Learning, AI for Science and Simulation

Community of Madrid, Spain
Joined September 2022
Photo by Francisco Giral (@fa_giral)Photo by Francisco Giral (@fa_giral)Photo by Francisco Giral (@fa_giral)Photo by Francisco Giral (@fa_giral)Photo by Francisco Giral (@fa_giral)Photo by Francisco Giral (@fa_giral)
On my way to Seoul 🇰🇷 for #ICML2026! Send me a DM if you want to grab a coffee and chat! Looking forward to connecting and having some great discussions! If you want to check the paper I´ll be presenting: arxiv.org/abs/2601.11440
42
Francisco Giral retweeted
Thrilled to share our work on foundation models+agentic AI for fluid mechanics! Our autonomous system selects the cases to analyze, generates the data and extracts the key flow metrics. The agreement with high-fidelity simulations is excellent.zenodo.org/records/18880613#… #AI4science
1
8
33
1,362
New paper out!! We develop a transformer-based reinforcement learning controller for fault-tolerant control of fixed-wing UAVs. The controller adapts to structural damage or actuator failures, enabling resilient autonomous flight under severe conditions.
New paper out! 🚀 We propose a transformer-based fault-tolerant controller for fixed-wing UAVs trained with offline reinforcement learning! It adapts to actuator failures and structural damage sciencedirect.com/science/ar… #AI #ReinforcementLearning #Transformers #UAV #Control
1
3
3
698
Francisco Giral retweeted
New video!! We describe our ideas and strategies to build #foundation #models integrating #agentic #AI systems! The goal: autonomous and automatic discovery, design and optimization!! This is on-going work with many collaborators. Stay tuned!! youtu.be/SJ7s4X7FIS8?si=0Q1N…
4
1
24
1,197
Lately I’ve been working on a side project: a reimplementation of the original GenCast model codebase, DeepMind’s diffusion-based medium-range weather forecasting model, using the “new” Flax API called NNX.
1
1
158
Added some nice 3D visualizations as well!
45
Nice!
PINA has joined the PyTorch Ecosystem, bringing a unified framework for Scientific Machine Learning to researchers and engineers. PINA is an open source Python library built on PyTorch, PyTorch Lightning, and compatible with PyTorch Geometric. It streamlines SciML workflows for modelling physical systems, solving PDEs, building machine learning force fields, simulating dynamics, and more. Its modular structure spans problem definition, model design, solver selection, and training, offering both flexibility and reproducibility. 🔗 Learn more and explore how to get involved: hubs.ly/Q03V4jrL0 #PyTorch #OpenSourceAI #SciML #MachineLearning
75
A few months ago I was working on this toy project. I wanted to try training a RL agent directly on real hardware (on a real cheap one), and I was looking for a safe, non-easily breakable setup to do that. This ended up with a really simple but quite didactic "bicopter".
1
3
11
1,481
SAC or TQC learned to solve the task (to follow the setpoint angle) in only 30k steps, which could take 10-25 minutes on a CPU-only machine. Observations were taken only from the IMU. Hand tracking is a nice touch added to control after training.
1
104
The hardware used was: - IMU MPU6050 (~ 3$) - Arduino (~ 15$) - Motor + ESC (~ 25-30$) Communication with the pc was handled through serial port. StableBaselines3 from @araffin2 was used for RL training. Github repo: github.com/fgiral000/bicopte…
115