You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-10 - 00:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Tue Jun 09, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3188375994441,2cyclictest3260736-21kworker/u8:1+events_unbound09:50:003
3188367994238,3cyclictest3438183-21kworker/u8:4+flush-259:011:55:001
3188365994238,3cyclictest3453487-21kworker/u8:0+flush-259:011:45:000
3188375993734,2cyclictest3515709-21kworker/u8:3+events_unbound12:30:003
3188375993733,3cyclictest3438183-21kworker/u8:4+flush-259:011:10:213
3188367993734,2cyclictest3494823-21kworker/u8:0+flush-259:012:15:241
3188375993431,2cyclictest3494823-21kworker/u8:0+flush-259:012:10:253
3188375993431,2cyclictest3250735-21kworker/u8:2+events_unbound08:30:193
3188367993431,2cyclictest3406644-21kworker/u8:2+flush-259:011:05:211
3188367993431,2cyclictest3369733-21kworker/u8:1+events_unbound10:15:201
3188367993431,2cyclictest3188357-21kworker/u8:1+flush-259:007:15:231
3188367993430,3cyclictest3438183-21kworker/u8:4+events_unbound11:20:231
3188365993428,5cyclictest3275529-21ntpq08:30:190
3188375993330,2cyclictest3369733-21kworker/u8:1+events_unbound10:15:163
3188375993330,2cyclictest3260736-21kworker/u8:1+flush-259:008:55:163
3188375993329,3cyclictest3479623-21kworker/u8:1+events_unbound12:00:223
3188375993329,3cyclictest3479623-21kworker/u8:1+events_unbound12:00:223
3188367993330,2cyclictest3260736-21kworker/u8:1+flush-259:008:40:011
3188367993329,2cyclictest3354413-21kworker/u8:0+flush-259:010:00:191
3188375993229,2cyclictest3494823-21kworker/u8:0+flush-259:012:10:003
3188375993229,2cyclictest3494823-21kworker/u8:0+flush-259:012:10:003
3188375993228,3cyclictest3250735-21kworker/u8:2+flush-259:008:25:203
3188367993227,2cyclictest3386252-21kworker/u8:0+flush-259:010:40:161
3188370993125,4cyclictest3422508-21latency_hist10:55:012
318836599310,30cyclictest509-21rs:main0
3188375993027,2cyclictest3401072-21kworker/u8:1+flush-259:010:50:203
3188375993027,2cyclictest3354413-21kworker/u8:0+events_unbound10:10:183
3188375993027,2cyclictest3188357-21kworker/u8:1+events_unbound07:40:193
3188375993024,2cyclictest3453487-21kworker/u8:0+events_unbound11:30:203
3188375992926,2cyclictest3369940-21kworker/u8:3+events_unbound10:25:213
3188375992926,2cyclictest3260736-21kworker/u8:1+flush-259:009:15:153
3188375992923,5cyclictest335557-21systemd-journal10:50:013
3188367992926,2cyclictest3494823-21kworker/u8:0+flush-259:012:05:201
3188367992926,2cyclictest3494823-21kworker/u8:0+flush-259:012:05:201
3188367992926,2cyclictest3260736-21kworker/u8:1+flush-259:009:00:151
3188367992926,2cyclictest3250735-21kworker/u8:2+flush-259:008:30:211
3188367992926,2cyclictest3128691-21kworker/u8:2+flush-259:007:10:231
3188367992923,2cyclictest3297100-21kworker/u8:2+events_unbound09:10:241
3188365992922,5cyclictest3317702-21latency_hist09:15:000
3188375992826,1cyclictest3369940-21kworker/u8:3+flush-259:010:20:263
3188375992825,2cyclictest3260736-21kworker/u8:1+flush-259:008:24:293
3188370992823,3cyclictest3464000-21/usr/sbin/munin11:35:222
3188367992825,2cyclictest3297100-21kworker/u8:2+events_unbound09:50:211
3188367992825,2cyclictest3128691-21kworker/u8:2+events_unbound07:50:231
3188367992823,3cyclictest1132699-21kworker/u8:3+events_unbound08:05:181
3188375992725,2cyclictest3260736-21kworker/u8:1+flush-259:009:40:153
3188375992724,2cyclictest3479623-21kworker/u8:1+events_unbound11:55:243
3188375992724,2cyclictest3354413-21kworker/u8:0+flush-259:010:00:203
3188367992724,2cyclictest3494823-21kworker/u8:0+events_unbound12:25:001
3188367992723,3cyclictest3369733-21kworker/u8:1+events_unbound10:15:001
3188367992723,3cyclictest335557-21systemd-journal07:35:291
3188367992722,3cyclictest3188357-21kworker/u8:1+events_unbound07:55:261
3188365992721,4cyclictest3214351-21/usr/sbin/munin07:35:180
3188375992623,2cyclictest3128691-21kworker/u8:2+flush-259:007:45:213
3188375992623,2cyclictest3128691-21kworker/u8:2+events_unbound07:20:233
3188370992622,3cyclictest509-21rs:main2
3188370992619,5cyclictest3391180-21latency_hist10:25:012
3188367992623,2cyclictest3401072-21kworker/u8:1+events_unbound10:50:261
3188367992623,2cyclictest3401072-21kworker/u8:1+events_unbound10:50:011
3188365992622,3cyclictest335557-21systemd-journal12:02:280
3188365992622,3cyclictest335557-21systemd-journal12:02:280
3188375992523,2cyclictest3406644-21kworker/u8:2+flush-259:010:40:263
3188375992523,2cyclictest3260736-21kworker/u8:1+events_unbound08:45:243
3188375992522,2cyclictest3438183-21kworker/u8:4+flush-259:011:45:203
3188375992522,2cyclictest3260736-21kworker/u8:1+flush-259:009:00:213
3188375992522,2cyclictest3128691-21kworker/u8:2+flush-259:007:35:223
3188370992519,4cyclictest335557-21systemd-journal11:00:002
3188367992522,2cyclictest3453487-21kworker/u8:0+events_unbound11:30:271
3188367992522,2cyclictest3422129-21kworker/u8:3+events_unbound11:45:321
3188367992520,2cyclictest3188357-21kworker/u8:1+flush-259:007:25:201
3188367992519,4cyclictest3342635-21ntpq09:35:221
3188367992518,2cyclictest3260736-21kworker/u8:1+events_unbound08:50:181
3188365992521,2cyclictest3510789-21apt-get12:20:120
3188375992421,2cyclictest3354413-21kworker/u8:0+events_unbound10:05:223
3188375992421,2cyclictest1132699-21kworker/u8:3+events_unbound08:05:233
3188375992419,3cyclictest3256070-21/usr/sbin/munin08:15:163
3188370992420,3cyclictest3438183-21kworker/u8:4+flush-259:011:20:252
3188367992421,2cyclictest3386252-21kworker/u8:0+flush-259:010:25:261
3188367992421,2cyclictest3297100-21kworker/u8:2+events_unbound09:20:181
3188375992321,2cyclictest3188357-21kworker/u8:1+flush-259:007:15:153
3188375992321,2cyclictest3128691-21kworker/u8:2+events_unbound07:29:403
3188375992321,2cyclictest3128691-21kworker/u8:2+events_unbound07:10:153
3188370992319,3cyclictest3417144-21gpgv10:50:012
3188370992317,4cyclictest3321955-21ntpq09:15:212
3188367992320,2cyclictest3453487-21kworker/u8:0+events_unbound11:25:221
3188367992320,2cyclictest3406644-21kworker/u8:2+events_unbound10:55:151
3188367992320,2cyclictest3260736-21kworker/u8:1+flush-259:008:20:181
3188365992320,2cyclictest3448566-21apt-get11:20:120
3188365992319,3cyclictest3225148-21apt-get07:45:120
3188365992317,4cyclictest3505598-21/usr/sbin/munin12:15:210
3188375992221,1cyclictest3453487-21kworker/u8:0+flush-259:011:25:153
3188375992220,2cyclictest3386252-21kworker/u8:0+flush-259:010:30:293
3188375992219,2cyclictest3297100-21kworker/u8:2+flush-259:009:55:233
3188375992219,2cyclictest3297100-21kworker/u8:2+events_unbound09:52:303
3188375992219,2cyclictest3260736-21kworker/u8:1+events_unbound08:40:213
3188370992217,4cyclictest335557-21systemd-journal08:10:012
3188367992219,2cyclictest3286825-21kworker/u8:0+flush-259:008:55:241
3188367992219,2cyclictest3260736-21kworker/u8:1+events_unbound09:25:191
3188367992218,3cyclictest3494823-21kworker/u8:0+events_unbound12:10:171
3188365992219,2cyclictest3260736-21kworker/u8:1+flush-259:009:15:170
3188365992216,4cyclictest335557-21systemd-journal10:55:000
3188365992216,4cyclictest3327116-21ntpq09:20:210
3188375992119,2cyclictest3401072-21kworker/u8:1+flush-259:010:35:213
3188375992118,2cyclictest3422129-21kworker/u8:3+flush-259:011:35:243
3188375992118,2cyclictest3422129-21kworker/u8:3+flush-259:011:20:153
3188375992118,2cyclictest3297100-21kworker/u8:2+flush-259:009:20:253
3188370992118,2cyclictest3515709-21kworker/u8:3+flush-259:012:25:252
3188367992118,2cyclictest3406644-21kworker/u8:2+events_unbound11:00:201
3188367992118,2cyclictest3369733-21kworker/u8:1+flush-259:010:05:151
3188367992118,2cyclictest3297100-21kworker/u8:2+flush-259:009:05:211
3188367992117,3cyclictest3369940-21kworker/u8:3+events_unbound10:20:151
3188367992117,3cyclictest3317933-21kworker/u8:0+events_unbound09:19:591
3188367992117,3cyclictest1132699-21kworker/u8:3+flush-259:008:00:201
3188365992115,4cyclictest3483893-21ntpq11:50:220
3188375992018,2cyclictest3406644-21kworker/u8:2+flush-259:010:55:203
3188375992018,2cyclictest3333806-21kworker/u8:3+events_unbound09:35:233
3188375992018,2cyclictest3317933-21kworker/u8:0+events_unbound09:34:213
3188375992017,2cyclictest3250735-21kworker/u8:2+events_unbound08:35:173
3188370992016,3cyclictest335557-21systemd-journal09:09:162
3188367992017,2cyclictest3515709-21kworker/u8:3+flush-259:012:25:251
3188367992015,4cyclictest3266395-21apt-get08:25:111
3188365992018,1cyclictest0-21swapper/007:14:590
3188365992017,2cyclictest3333806-21kworker/u8:3+flush-259:009:45:260
3188375991917,2cyclictest3479623-21kworker/u8:1+events_unbound12:19:293
3188375991916,2cyclictest3260736-21kworker/u8:1+flush-259:009:05:233
3188370991916,2cyclictest3438183-21kworker/u8:4+flush-259:011:10:152
3188370991915,3cyclictest3260736-21kworker/u8:1+flush-259:008:40:222
3188370991915,3cyclictest1132699-21kworker/u8:3+flush-259:007:40:012
3188370991914,4cyclictest3301394-21ntpq08:55:222
3188370991914,3cyclictest3437959-21latency_hist11:10:022
3188367991916,2cyclictest3438183-21kworker/u8:4+flush-259:011:40:201
3188367991916,2cyclictest3297100-21kworker/u8:2+events_unbound09:55:151
3188367991916,2cyclictest3128691-21kworker/u8:2+events_unbound07:40:031
3188367991915,3cyclictest509-21rs:main1
3188367991913,2cyclictest3333806-21kworker/u8:3+events_unbound09:45:141
3188365991913,4cyclictest335557-21systemd-journal10:35:000
318836599190,17cyclictest509-21rs:main0
3188375991816,2cyclictest3406644-21kworker/u8:2+events_unbound11:15:153
3188375991815,2cyclictest3438183-21kworker/u8:4+events_unbound11:52:283
318837599181,15cyclictest1-21systemd07:58:283
3188367991815,2cyclictest3494823-21kworker/u8:0+events_unbound12:04:281
3188367991815,2cyclictest3494823-21kworker/u8:0+events_unbound12:04:281
3188367991815,2cyclictest3406644-21kworker/u8:2+flush-259:011:15:201
3188367991814,3cyclictest3333806-21kworker/u8:3+events_unbound09:33:311
3188367991811,5cyclictest335557-21systemd-journal07:25:001
3188365991814,3cyclictest3468926-21gpgv11:40:000
3188365991813,3cyclictest335557-21systemd-journal07:20:270
3188375991715,2cyclictest3453487-21kworker/u8:0+events_unbound11:41:293
3188375991715,2cyclictest3406644-21kworker/u8:2+events_unbound11:09:463
3188375991714,2cyclictest3521516-21irqcore12:30:143
3188375991714,2cyclictest3260736-21kworker/u8:1+events_unbound09:25:153
3188375991714,2cyclictest1132699-21kworker/u8:3+flush-259:008:11:323
318837099176,5cyclictest3208960-21munin-run07:29:592
3188370991715,1cyclictest0-21swapper/210:10:002
3188370991714,2cyclictest3479623-21kworker/u8:1+flush-259:012:35:172
3188370991714,2cyclictest3297100-21kworker/u8:2+flush-259:009:55:252
3188370991714,2cyclictest3297100-21kworker/u8:2+flush-259:009:50:232
3188367991714,2cyclictest3380451-21kworker/u8:2+events_unbound10:30:151
3188367991714,2cyclictest3188357-21kworker/u8:1+flush-259:007:35:011
3188367991714,2cyclictest3128691-21kworker/u8:2+events_unbound07:45:191
3188367991713,3cyclictest3260736-21kworker/u8:1+flush-259:008:45:291
3188367991713,3cyclictest3260736-21kworker/u8:1+events_unbound09:40:161
3188365991712,4cyclictest3437088-21ntpq11:05:220
3188375991614,2cyclictest3479623-21kworker/u8:1+flush-259:012:20:273
3188375991613,2cyclictest3297100-21kworker/u8:2+events_unbound09:14:563
3188375991613,2cyclictest3245537-21cron08:05:003
3188370991614,1cyclictest0-21swapper/207:15:162
3188370991612,3cyclictest3438183-21kworker/u8:4+flush-259:011:50:002
3188370991612,3cyclictest3260736-21kworker/u8:1+flush-259:008:20:252
3188370991611,4cyclictest3479623-21kworker/u8:1+flush-259:012:15:052
3188370991611,3cyclictest3348636-21turbostat.cron09:45:002
3188367991613,2cyclictest3479623-21kworker/u8:1+events_unbound12:35:211
3188367991613,2cyclictest3453487-21kworker/u8:0+events_unbound11:39:461
3188367991613,2cyclictest3240387-21kworker/u8:0+events_unbound08:11:301
3188367991612,3cyclictest3260736-21kworker/u8:1+flush-259:008:41:331
3188367991612,3cyclictest1132699-21kworker/u8:3+events_unbound08:15:131
318836599169,5cyclictest3379509-21ntpq10:10:190
3188365991613,2cyclictest60350irq/132-enp0s29f1:rx-012:40:000
3188365991613,2cyclictest60350irq/132-enp0s29f1:rx-011:50:000
3188365991611,4cyclictest3505357-21latency_hist12:15:000
3188365991611,4cyclictest3462920-21ntpq11:30:210
3188365991611,3cyclictest3375284-21cp10:10:010
318837099159,4cyclictest3525085-21ntpq12:30:202
3188370991513,1cyclictest0-21swapper/212:00:212
3188370991513,1cyclictest0-21swapper/212:00:202
3188370991512,2cyclictest3396759-21fschecks_count10:30:132
3188370991512,2cyclictest3260736-21kworker/u8:1+flush-259:009:50:002
3188370991511,3cyclictest3494823-21kworker/u8:0+flush-259:012:25:002
3188367991511,3cyclictest3479623-21kworker/u8:1+events_unbound12:31:201
3188365991513,2cyclictest60350irq/132-enp0s29f1:rx-011:55:590
3188365991513,1cyclictest60350irq/132-enp0s29f1:rx-011:00:120
3188365991513,1cyclictest60350irq/132-enp0s29f1:rx-010:42:440
3188365991513,1cyclictest60350irq/132-enp0s29f1:rx-010:00:440
3188365991513,1cyclictest60350irq/132-enp0s29f1:rx-008:24:340
3188365991512,2cyclictest60350irq/132-enp0s29f1:rx-010:55:130
3188365991512,2cyclictest3343049-21unixbench_singl09:35:260
3188365991512,2cyclictest3312062-21unixbench_multi09:05:240
3188365991512,2cyclictest3251016-21cpuspeed_turbos08:10:100
3188365991510,4cyclictest3458629-21latency_hist11:30:000
3188365991510,4cyclictest335557-21systemd-journal08:44:550
3188375991412,2cyclictest3260736-21kworker/u8:1+events_unbound08:54:143
318837099149,4cyclictest3484768-21latency_hist11:55:002
318837099149,4cyclictest3406889-21apt-get10:40:132
318837099147,5cyclictest3379612-21ntpq10:10:212
3188367991411,2cyclictest3422129-21kworker/u8:3+events_unbound11:55:441
3188367991411,2cyclictest3386252-21kworker/u8:0+events_unbound10:37:291
318836599149,3cyclictest3359340-21latency_hist09:55:010
3188365991413,1cyclictest60350irq/132-enp0s29f1:rx-009:26:250
3188365991413,1cyclictest60350irq/132-enp0s29f1:rx-008:55:020
3188365991412,2cyclictest60350irq/132-enp0s29f1:rx-007:32:540
3188365991412,1cyclictest60350irq/132-enp0s29f1:rx-011:10:170
3188365991412,1cyclictest60350irq/132-enp0s29f1:rx-010:15:050
3188365991412,1cyclictest60350irq/132-enp0s29f1:rx-008:45:140
3188365991412,1cyclictest60350irq/132-enp0s29f1:rx-008:05:170
3188365991411,2cyclictest60350irq/132-enp0s29f1:rx-012:30:220
3188365991411,2cyclictest60350irq/132-enp0s29f1:rx-010:25:110
3188365991411,2cyclictest60350irq/132-enp0s29f1:rx-009:32:200
3188365991411,2cyclictest60350irq/132-enp0s29f1:rx-008:25:110
3188365991411,2cyclictest60350irq/132-enp0s29f1:rx-008:02:310
3188365991411,2cyclictest60350irq/132-enp0s29f1:rx-007:15:230
3188375991310,2cyclictest3234386-21ntp_offset07:50:223
318837099137,4cyclictest335557-21systemd-journal11:15:222
3188370991310,2cyclictest3317211-21unixbench_multi09:10:252
3188370991310,2cyclictest3239876-21unixbench_multi07:55:252
3188370991310,2cyclictest3188847-21fschecks_time07:10:132
318836599139,3cyclictest3260736-21kworker/u8:1+flush-259:009:40:150
318836599138,3cyclictest335557-21systemd-journal07:54:540
3188365991311,1cyclictest60350irq/132-enp0s29f1:rx-010:45:230
3188365991311,1cyclictest60350irq/132-enp0s29f1:rx-008:15:210
3188365991311,1cyclictest60350irq/132-enp0s29f1:rx-007:56:330
3188365991311,1cyclictest60350irq/132-enp0s29f1:rx-007:40:250
3188365991310,2cyclictest3495496-21fschecks_count12:05:130
3188365991310,2cyclictest3495496-21fschecks_count12:05:120
318837599129,2cyclictest3128691-21kworker/u8:2+events_unbound07:30:053
318837099129,2cyclictest3297100-21kworker/u8:2+flush-259:009:25:262
318837099129,2cyclictest3188357-21kworker/u8:1+flush-259:007:40:242
318837099128,3cyclictest3479623-21kworker/u8:1+flush-259:011:55:252
318837099127,4cyclictest3276454-21latency_hist08:35:012
318836599129,2cyclictest60350irq/132-enp0s29f1:rx-010:35:140
318836599129,2cyclictest60350irq/132-enp0s29f1:rx-008:35:190
318836599129,1cyclictest0-21swapper/010:20:240
3188365991210,1cyclictest60350irq/132-enp0s29f1:rx-007:25:160
318837599118,2cyclictest3479623-21kworker/u8:1+events_unbound12:35:163
318837099117,2cyclictest3260979-21cron08:20:012
318837099115,4cyclictest335557-21systemd-journal08:50:012
318837099108,1cyclictest3402150-21irqcore10:35:182
318837099108,1cyclictest0-21swapper/211:30:182
318837099108,1cyclictest0-21swapper/210:15:182
318837099107,1cyclictest0-21swapper/207:45:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional