You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 11:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Mon Dec 08, 2025 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29274994141,0cyclictest20087-21fwupd20:02:480
29287991918,1cyclictest66850irq/125-lan23:52:533
29287991918,1cyclictest66850irq/125-lan23:05:283
29287991918,1cyclictest66850irq/125-lan21:30:193
29287991918,1cyclictest66850irq/125-lan19:52:023
29287991918,1cyclictest66850irq/125-lan19:40:003
29287991918,1cyclictest66850irq/125-lan19:30:003
29287991918,1cyclictest66850irq/125-lan00:16:253
29287991818,0cyclictest66850irq/125-lan22:30:183
29287991818,0cyclictest66850irq/125-lan22:26:463
29287991818,0cyclictest66850irq/125-lan22:01:443
29287991818,0cyclictest66850irq/125-lan21:16:393
29287991818,0cyclictest66850irq/125-lan20:59:023
29287991818,0cyclictest66850irq/125-lan20:18:403
29287991818,0cyclictest66850irq/125-lan00:20:143
29287991817,1cyclictest66850irq/125-lan23:45:143
29287991817,1cyclictest66850irq/125-lan23:40:183
29287991817,1cyclictest66850irq/125-lan23:33:443
29287991817,1cyclictest66850irq/125-lan23:28:113
29287991817,1cyclictest66850irq/125-lan21:59:073
29287991817,1cyclictest66850irq/125-lan21:59:063
29287991817,1cyclictest66850irq/125-lan21:45:583
29287991817,1cyclictest66850irq/125-lan21:40:143
29287991817,1cyclictest66850irq/125-lan21:35:163
29287991817,1cyclictest66850irq/125-lan21:25:123
29287991817,1cyclictest66850irq/125-lan21:11:193
29287991817,1cyclictest66850irq/125-lan20:05:313
29287991817,1cyclictest66850irq/125-lan00:37:173
29287991717,0cyclictest66850irq/125-lan23:22:453
29287991717,0cyclictest66850irq/125-lan22:43:113
29287991717,0cyclictest66850irq/125-lan22:35:133
29287991717,0cyclictest66850irq/125-lan22:19:353
29287991717,0cyclictest66850irq/125-lan20:13:183
29287991717,0cyclictest66850irq/125-lan00:30:553
29287991717,0cyclictest66850irq/125-lan00:25:163
29287991716,1cyclictest66850irq/125-lan23:55:203
29287991716,1cyclictest66850irq/125-lan23:36:063
29287991716,1cyclictest66850irq/125-lan23:16:473
29287991716,1cyclictest66850irq/125-lan23:00:303
29287991716,1cyclictest66850irq/125-lan22:56:253
29287991716,1cyclictest66850irq/125-lan22:45:433
29287991716,1cyclictest66850irq/125-lan22:10:563
29287991716,1cyclictest66850irq/125-lan22:09:523
29287991716,1cyclictest66850irq/125-lan21:53:533
29287991716,1cyclictest66850irq/125-lan21:53:533
29287991716,1cyclictest66850irq/125-lan19:45:013
29287991716,1cyclictest66850irq/125-lan00:10:163
29287991716,1cyclictest66850irq/125-lan00:06:003
29287991716,1cyclictest66850irq/125-lan00:02:253
29274991717,0cyclictest31916-21cat19:15:160
29287991616,0cyclictest66850irq/125-lan23:12:083
29287991616,0cyclictest66850irq/125-lan22:21:443
29287991615,1cyclictest66850irq/125-lan22:51:503
29287991615,1cyclictest66850irq/125-lan21:20:063
29287991615,1cyclictest66850irq/125-lan20:37:183
29287991615,1cyclictest66850irq/125-lan20:20:173
29287991615,1cyclictest66850irq/125-lan19:10:233
29278991616,0cyclictest771-21snmpd21:59:011
29278991616,0cyclictest771-21snmpd21:59:001
29278991616,0cyclictest771-21snmpd21:02:291
29274991616,0cyclictest771-21snmpd20:20:030
29274991616,0cyclictest771-21snmpd20:12:380
29274991616,0cyclictest771-21snmpd00:17:480
29274991615,1cyclictest16661-21kworker/0:3+events22:17:260
29287991515,0cyclictest66850irq/125-lan20:26:183
29287991514,1cyclictest66850irq/125-lan21:05:153
29287991514,1cyclictest66850irq/125-lan20:00:153
29287991514,1cyclictest66850irq/125-lan19:25:213
29278991515,0cyclictest771-21snmpd23:57:291
29278991515,0cyclictest771-21snmpd23:41:291
29278991515,0cyclictest771-21snmpd23:11:581
29278991515,0cyclictest771-21snmpd20:41:151
29274991515,0cyclictest771-21snmpd23:41:560
29274991515,0cyclictest771-21snmpd23:00:470
29274991515,0cyclictest771-21snmpd22:41:090
29274991515,0cyclictest771-21snmpd21:27:530
29274991515,0cyclictest771-21snmpd21:05:430
29274991515,0cyclictest771-21snmpd20:36:330
29274991515,0cyclictest771-21snmpd19:29:580
29274991515,0cyclictest771-21snmpd00:34:040
29274991515,0cyclictest771-21snmpd00:04:390
29274991514,1cyclictest16661-21kworker/0:3+events22:09:380
29287991413,1cyclictest66850irq/125-lan21:00:173
29287991413,1cyclictest66850irq/125-lan19:40:013
29287991413,1cyclictest66850irq/125-lan19:20:213
29278991414,0cyclictest771-21snmpd23:51:161
29278991414,0cyclictest771-21snmpd23:24:421
29278991414,0cyclictest771-21snmpd23:01:331
29278991414,0cyclictest771-21snmpd22:00:211
29278991414,0cyclictest10456-21cat19:40:151
29274991414,0cyclictest771-21snmpd22:51:560
29274991414,0cyclictest771-21snmpd22:22:550
29274991414,0cyclictest771-21snmpd22:11:350
29274991414,0cyclictest771-21snmpd20:16:160
29274991414,0cyclictest771-21snmpd19:55:290
29274991413,1cyclictest4448-21kworker/0:1+events23:12:330
29287991312,1cyclictest66850irq/125-lan20:50:193
29287991312,1cyclictest66850irq/125-lan20:45:223
29287991312,1cyclictest66850irq/125-lan20:40:213
29287991312,1cyclictest66850irq/125-lan19:55:193
29278991313,0cyclictest771-21snmpd23:27:281
29278991313,0cyclictest771-21snmpd22:46:141
29278991313,0cyclictest771-21snmpd22:35:241
29278991313,0cyclictest771-21snmpd21:50:181
29278991313,0cyclictest771-21snmpd21:50:181
29278991313,0cyclictest771-21snmpd20:56:431
29278991313,0cyclictest771-21snmpd20:52:281
29278991313,0cyclictest771-21snmpd20:17:551
29278991313,0cyclictest684-21cat22:30:151
29274991312,1cyclictest16661-21kworker/0:3+events21:10:580
29287991211,1cyclictest66850irq/125-lan19:15:153
29278991212,0cyclictest771-21snmpd21:06:131
29278991212,0cyclictest771-21snmpd20:27:451
29278991212,0cyclictest771-21snmpd19:16:521
29278991210,2cyclictest749-21ntpd22:12:181
29287991111,0cyclictest66850irq/125-lan20:30:123
2927499109,1cyclictest4448-21kworker/0:1+events22:59:170
292839998,1cyclictest524-21avahi-daemon23:27:272
292839998,1cyclictest524-21avahi-daemon22:22:542
292789999,0cyclictest771-21snmpd20:35:511
292789998,1cyclictest255-20systemd-journal23:33:221
292789996,3cyclictest771-21snmpd22:28:551
292749999,0cyclictest769-21lldpd22:36:100
292749998,1cyclictest771-21snmpd22:26:350
292749998,1cyclictest771-21snmpd19:41:310
292749998,1cyclictest749-21ntpd22:04:100
292839988,0cyclictest771-21snmpd23:50:072
292839988,0cyclictest771-21snmpd23:45:582
292839988,0cyclictest771-21snmpd22:54:592
292839988,0cyclictest771-21snmpd21:47:012
292839988,0cyclictest771-21snmpd21:37:112
292839988,0cyclictest771-21snmpd21:22:292
292839988,0cyclictest771-21snmpd00:05:142
292839988,0cyclictest769-21lldpd23:21:572
292839988,0cyclictest769-21lldpd21:58:212
292839988,0cyclictest769-21lldpd21:58:202
292839988,0cyclictest769-21lldpd21:15:122
292839988,0cyclictest769-21lldpd19:21:052
292839987,1cyclictest771-21snmpd22:50:122
292839987,1cyclictest769-21lldpd19:35:392
292839987,1cyclictest524-21avahi-daemon21:53:352
292839987,1cyclictest524-21avahi-daemon21:53:352
292839986,2cyclictest771-21snmpd23:57:052
292839986,2cyclictest771-21snmpd23:32:312
292839986,2cyclictest771-21snmpd19:53:292
292839986,2cyclictest771-21snmpd19:26:472
292839986,2cyclictest683-21cat22:30:152
292789988,0cyclictest769-21lldpd23:05:151
292789988,0cyclictest769-21lldpd22:23:231
292789988,0cyclictest769-21lldpd21:16:561
292789988,0cyclictest769-21lldpd00:39:501
292789988,0cyclictest517-21systemd-resolve19:35:481
292789987,1cyclictest771-21snmpd21:40:361
292789987,1cyclictest771-21snmpd20:10:321
292789987,1cyclictest769-21lldpd19:59:301
292789986,2cyclictest771-21snmpd23:46:581
292789986,2cyclictest749-21ntpd23:35:361
292789986,2cyclictest749-21ntpd23:19:231
292789986,2cyclictest749-21ntpd22:59:461
292789986,2cyclictest749-21ntpd22:42:431
292789986,2cyclictest749-21ntpd21:35:381
292789986,2cyclictest749-21ntpd00:20:181
292789986,2cyclictest749-21ntpd00:12:591
292749988,0cyclictest771-21snmpd21:03:110
292749988,0cyclictest771-21snmpd20:51:430
292749988,0cyclictest771-21snmpd00:05:290
292749988,0cyclictest769-21lldpd23:32:430
292749987,1cyclictest771-21snmpd21:36:080
292749987,1cyclictest771-21snmpd21:19:450
292749987,1cyclictest771-21snmpd19:11:140
292749987,1cyclictest16661-21kworker/0:3+events20:31:520
292749986,2cyclictest771-21snmpd23:45:500
292749986,2cyclictest749-21ntpd23:56:150
292749986,2cyclictest749-21ntpd23:27:380
292749986,2cyclictest749-21ntpd22:46:210
292749986,2cyclictest749-21ntpd22:33:430
292749986,2cyclictest749-21ntpd21:57:570
292749986,2cyclictest749-21ntpd21:57:560
292749986,2cyclictest749-21ntpd21:52:280
292749986,2cyclictest749-21ntpd21:52:280
292749986,2cyclictest16661-21kworker/0:3+events19:50:190
292839977,0cyclictest771-21snmpd22:44:532
292839977,0cyclictest771-21snmpd21:04:082
292839977,0cyclictest771-21snmpd20:27:572
292839977,0cyclictest769-21lldpd23:41:342
292839977,0cyclictest769-21lldpd20:16:042
292839977,0cyclictest769-21lldpd19:57:212
292839977,0cyclictest769-21lldpd00:17:302
292839976,1cyclictest771-21snmpd21:12:132
292839976,1cyclictest771-21snmpd20:23:542
292839976,1cyclictest524-21avahi-daemon23:38:462
292839976,1cyclictest18140-21cpuspeed_turbos00:25:162
292839975,2cyclictest771-21snmpd23:16:212
292839975,2cyclictest771-21snmpd20:33:482
292839975,2cyclictest771-21snmpd20:10:412
292839975,2cyclictest771-21snmpd19:18:402
292839973,3cyclictest255-20systemd-journal23:08:332
292789977,0cyclictest769-21lldpd19:13:401
292789976,1cyclictest749-21ntpd21:49:551
292789976,1cyclictest749-21ntpd21:34:171
292789976,1cyclictest749-21ntpd21:25:171
292789976,1cyclictest749-21ntpd00:15:391
292789976,1cyclictest749-21ntpd00:09:381
292789975,2cyclictest771-21snmpd19:24:011
292789975,2cyclictest749-21ntpd22:15:381
292789975,2cyclictest749-21ntpd21:10:231
292789975,2cyclictest749-21ntpd19:25:231
292789973,3cyclictest18679-21df_inode20:00:121
292789973,3cyclictest14771-21fw_forwarded_lo19:50:151
292749977,0cyclictest771-21snmpd19:36:400
292749977,0cyclictest769-21lldpd23:20:130
292749977,0cyclictest769-21lldpd20:27:220
292749977,0cyclictest769-21lldpd19:24:190
292749976,1cyclictest769-21lldpd00:36:300
292749976,1cyclictest749-21ntpd23:52:120
292749976,1cyclictest749-21ntpd21:31:130
292749976,1cyclictest4448-21kworker/0:1+events23:08:440
292749976,1cyclictest4448-21kworker/0:1+events00:20:140
292749976,1cyclictest4448-21kworker/0:1+events00:12:230
292749976,1cyclictest25855-21gltestperf21:20:150
292749976,1cyclictest16661-21kworker/0:3+events21:46:380
292749976,1cyclictest16661-21kworker/0:3+events21:42:420
292749976,1cyclictest16661-21kworker/0:3+events20:45:230
292749976,1cyclictest16661-21kworker/0:3+events20:05:010
292749975,2cyclictest771-21snmpd19:48:440
292749973,3cyclictest3326-21memory23:35:160
292839966,0cyclictest771-21snmpd22:00:062
292839966,0cyclictest771-21snmpd20:53:222
292839966,0cyclictest771-21snmpd00:35:002
292839966,0cyclictest771-21snmpd00:22:592
292839966,0cyclictest769-21lldpd22:25:282
292839966,0cyclictest769-21lldpd22:08:232
292839966,0cyclictest769-21lldpd21:33:042
292839966,0cyclictest769-21lldpd20:41:042
292839966,0cyclictest769-21lldpd19:48:062
292839965,1cyclictest771-21snmpd19:41:412
292839965,1cyclictest771-21snmpd19:32:072
292839964,2cyclictest771-21snmpd22:13:102
292839964,2cyclictest771-21snmpd00:10:512
292839963,2cyclictest586-21rs:main2
292839962,3cyclictest7703-21ssh22:36:432
292789966,0cyclictest771-21snmpd22:05:011
292789966,0cyclictest769-21lldpd20:08:221
292789966,0cyclictest769-21lldpd00:25:571
292789965,1cyclictest749-21ntpd22:53:451
292789965,1cyclictest524-21avahi-daemon21:21:581
292789964,2cyclictest771-21snmpd20:46:231
292789964,2cyclictest749-21ntpd19:30:161
292789963,2cyclictest30888-21ssh00:02:031
292789963,2cyclictest27000-21seq20:20:041
292749965,1cyclictest16661-21kworker/0:3+events20:40:200
292749962,3cyclictest15616-21ntp_states23:15:170
292749961,4cyclictest771-21snmpd00:25:140
292839955,0cyclictest769-21lldpd21:40:092
292839955,0cyclictest769-21lldpd19:13:252
292839955,0cyclictest524-21avahi-daemon20:04:212
292839954,1cyclictest9408-21fschecks_time20:55:142
292839953,2cyclictest771-21snmpd23:00:172
292839953,2cyclictest10128-21cat23:10:142
292839952,3cyclictest550-21NetworkManager20:35:232
292839952,3cyclictest5450-21fw_forwarded_lo20:45:152
292839952,2cyclictest586-21rs:main2
292839952,2cyclictest29878-21sh00:00:302
292839952,2cyclictest255-20systemd-journal22:17:012
292839952,2cyclictest13435-21grep21:05:162
292839951,4cyclictest23426-21head00:30:122
292789954,1cyclictest0-21swapper/100:30:011
292789952,2cyclictest31461-21seq20:30:091
292789951,4cyclictest550-21NetworkManager19:49:131
292749955,0cyclictest769-21lldpd19:30:150
292749950,4cyclictest10043-21ntpq20:55:200
292839941,2cyclictest20906-21apt-key20:05:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional