Skip to main content
ENHU
Home

Main navigation

  • Discover
    • News
    • Events
    • Tenders
  • Research fields
  • Resources
    • Publications
    • Downloads
    • Brochure
  • About us
  • Partners
  1. Home
  2. Events
Apr 5, 2023 | 3:00pm
Teams

On the Functional Similarity of Robust and Non-Robust Neural Representations

Teams
Széchenyi Plusz RRF

Watch the full lecture here (in Hungarian)!

Model stitching, a method developed to test the functional similarity of neural representations has showed that different neural networks trained on the same task have surprisingly similar internal representations. However, it is widely believed that adversarially robust networks are considerably different from their non-robust counterparts and therefore produce different representations. This is evidenced by the fact that the representations of robust image classifiers are invertible, whereas non-robust representations are not. Our research aims to investigate the similarities and differences between robust and non-robust representations from a functional standpoint. We show that these representations are compatible regarding clean accuracy, but from the point of view of robust accuracy, this compatibility drops quickly after the first few, preprocessing layers. In the later layers however, stitching can test a different kind of similarity. We use this to show that for any classifier, these layers mostly depend on the abstract task specification and therefore cross-task stitching is also feasible, even across robust networks and adversarial classification tasks.

Lecturer: Balogh András (SZTE)

Home

LinkedIn

Become a partner

Subscribe to newsletter

Send partnership request

Explore

  • News
  • Events
  • Tenders
  • Publications
  • Downloads
  • Partners

Research fields

  • Foundations of AI
  • Human Language Processing
  • Machine perception
  • Medical, Health and Biology
  • Security and Privacy
  • Sensors, IoT and Telecommunications

Contact us

Hungary, H-1111 Budapest,
Kende u. 13-17.
+36 1 279 6000
@email

© 2020-2021 Artifical Intelligence National Laboratory, Budapest