Wasp Summer School 2022


About

The WASP Summer School Synthesis of Human Communication 2022 was a networking event organized by Wallenberg AI, Autonomous Systems and Software Program. It took place in Norrköping, Sweden, between 22-Aug-2022 and 26-Aug-2022.

Speakers from industrial and academic backgrounds were invited to present their work to attendees, while PhD students were tasked with completing an assignment on the topic of generative AI, to earn credits towards their degrees.

The summer school was rounded off in the Norrköping Visualisation Center 3D dome, in which 3D video demos showcasing the students’ submissions were presented.


Responsibilities

Teaching & Organization:

  • Write a technical gesture generation tutorial with student exercises.
  • Mentor students during the completion of the gesture generation tutorial.
  • Organize and coordinate the collection of assignment submissions.
  • Plan the testing of hardware and software in the Norrköping Visualisation Center 3D dome.

Technical:

  • Maintain a Git repository with instructions for the student assignment.
  • Train a Python AI model on a gesture dataset to generate BVH gesture animations for speaking avatars. Multiple models were trained with different hyperparameters, deployed using Docker on a remote Linux machine.
  • Produce 4 cinematics in Unreal Engine 4.27 from FBX data, in collaboration with Mihail Tsakov.
  • Build an nDisplay project (UE4.27) and test it in the Norrköping Visualisation Center 3D dome.

For technical details, check the assignment instructions and gesture generation tutorial Git repos.