You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-04 - 17:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Tue Aug 04, 2026 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32523991918,1cyclictest65850irq/126-lan10:30:110
32523991918,1cyclictest65850irq/126-lan07:14:570
32523991818,0cyclictest65850irq/126-lan10:41:400
32523991818,0cyclictest65850irq/126-lan08:35:200
32523991818,0cyclictest65850irq/126-lan08:24:010
32523991818,0cyclictest65850irq/126-lan08:00:170
32523991817,1cyclictest65850irq/126-lan09:55:180
32523991817,1cyclictest65850irq/126-lan09:10:210
32523991817,1cyclictest65850irq/126-lan09:05:150
32523991817,1cyclictest65850irq/126-lan07:30:160
32523991717,0cyclictest65850irq/126-lan12:05:120
32523991717,0cyclictest65850irq/126-lan11:45:170
32523991717,0cyclictest65850irq/126-lan08:55:010
32523991717,0cyclictest65850irq/126-lan08:50:140
32523991717,0cyclictest65850irq/126-lan08:25:170
32523991717,0cyclictest65850irq/126-lan07:40:130
32523991716,1cyclictest65850irq/126-lan10:15:220
32523991716,1cyclictest65850irq/126-lan10:05:190
32523991716,1cyclictest65850irq/126-lan08:15:190
32523991616,0cyclictest65850irq/126-lan11:55:210
32523991616,0cyclictest65850irq/126-lan11:19:520
32523991616,0cyclictest65850irq/126-lan10:55:160
32523991616,0cyclictest65850irq/126-lan10:45:150
32523991616,0cyclictest65850irq/126-lan10:00:150
32523991616,0cyclictest65850irq/126-lan09:30:130
32523991616,0cyclictest65850irq/126-lan08:33:300
32523991616,0cyclictest65850irq/126-lan08:10:120
32523991616,0cyclictest65850irq/126-lan07:53:000
32523991615,1cyclictest65850irq/126-lan12:20:190
32523991615,1cyclictest65850irq/126-lan12:19:250
32523991615,1cyclictest65850irq/126-lan11:30:150
32523991615,1cyclictest65850irq/126-lan11:05:190
32523991615,1cyclictest65850irq/126-lan10:53:540
32523991615,1cyclictest65850irq/126-lan10:20:120
32523991615,1cyclictest65850irq/126-lan09:16:390
32523991615,1cyclictest65850irq/126-lan08:05:210
32530991515,0cyclictest26648-21cat10:50:131
32523991515,0cyclictest65850irq/126-lan12:35:160
32523991515,0cyclictest65850irq/126-lan10:35:160
32523991515,0cyclictest65850irq/126-lan10:10:180
32523991515,0cyclictest65850irq/126-lan09:45:130
32523991515,0cyclictest65850irq/126-lan09:25:140
32523991515,0cyclictest65850irq/126-lan09:20:110
32523991515,0cyclictest65850irq/126-lan07:35:210
32523991514,1cyclictest65850irq/126-lan12:10:170
32523991514,1cyclictest65850irq/126-lan08:45:200
32523991414,0cyclictest65850irq/126-lan12:25:180
32523991414,0cyclictest65850irq/126-lan11:00:150
32523991414,0cyclictest65850irq/126-lan09:00:140
32523991414,0cyclictest65850irq/126-lan07:20:180
32523991413,1cyclictest65850irq/126-lan12:00:150
32523991413,1cyclictest65850irq/126-lan11:50:160
32523991413,1cyclictest65850irq/126-lan09:50:130
32530991313,0cyclictest743-21snmpd10:32:331
32530991313,0cyclictest743-21snmpd08:28:171
32530991313,0cyclictest743-21snmpd08:05:451
32530991313,0cyclictest743-21snmpd07:16:101
32530991313,0cyclictest19431-21cat07:55:141
32523991313,0cyclictest65850irq/126-lan11:36:000
32530991212,0cyclictest8854-21cat07:30:151
32530991212,0cyclictest743-21snmpd10:07:571
32530991212,0cyclictest743-21snmpd09:11:551
32530991212,0cyclictest743-21snmpd08:53:011
32530991212,0cyclictest24639-21cat10:45:131
32523991212,0cyclictest65850irq/126-lan11:25:130
32523991212,0cyclictest65850irq/126-lan10:25:130
32523991212,0cyclictest65850irq/126-lan09:40:160
32523991211,1cyclictest65850irq/126-lan07:20:000
32530991111,0cyclictest743-21snmpd12:38:021
32530991111,0cyclictest743-21snmpd11:52:551
32530991111,0cyclictest743-21snmpd11:37:421
32530991111,0cyclictest743-21snmpd11:31:511
32530991111,0cyclictest743-21snmpd10:00:421
32530991111,0cyclictest743-21snmpd07:52:171
32530991111,0cyclictest20949-21cat11:55:161
32523991111,0cyclictest65850irq/126-lan11:43:170
32523991111,0cyclictest65850irq/126-lan09:35:220
32523991111,0cyclictest65850irq/126-lan08:43:430
32523991110,1cyclictest65850irq/126-lan07:55:120
32523991010,0cyclictest743-21snmpd12:32:260
32523991010,0cyclictest65850irq/126-lan11:10:130
32523991010,0cyclictest65850irq/126-lan07:45:150
325389998,1cyclictest741-21lldpd09:36:323
325389998,1cyclictest741-21lldpd07:25:333
325389996,3cyclictest743-21snmpd07:42:263
325359998,1cyclictest743-21snmpd08:09:272
325359998,1cyclictest741-21lldpd09:41:232
325309999,0cyclictest743-21snmpd12:09:101
325309998,1cyclictest743-21snmpd11:25:031
325309998,1cyclictest741-21lldpd11:44:281
325239999,0cyclictest65850irq/126-lan11:20:150
325389988,0cyclictest743-21snmpd12:38:353
325389988,0cyclictest743-21snmpd11:57:103
325389988,0cyclictest743-21snmpd10:53:563
325389988,0cyclictest743-21snmpd10:14:093
325389988,0cyclictest743-21snmpd07:45:233
325389988,0cyclictest741-21lldpd11:51:503
325389988,0cyclictest741-21lldpd11:08:183
325389988,0cyclictest741-21lldpd09:02:303
325389987,1cyclictest743-21snmpd11:46:183
325389987,1cyclictest743-21snmpd09:29:493
325389987,1cyclictest743-21snmpd07:52:583
325389986,2cyclictest743-21snmpd11:22:003
325389986,2cyclictest743-21snmpd09:23:263
325389986,2cyclictest743-21snmpd08:59:223
325389986,2cyclictest743-21snmpd07:31:353
325359988,0cyclictest743-21snmpd12:34:022
325359988,0cyclictest743-21snmpd11:26:302
325359988,0cyclictest743-21snmpd11:13:412
325359988,0cyclictest743-21snmpd09:46:392
325359988,0cyclictest741-21lldpd12:35:532
325359988,0cyclictest741-21lldpd11:02:482
325359988,0cyclictest741-21lldpd10:53:142
325359988,0cyclictest741-21lldpd09:21:062
325359988,0cyclictest741-21lldpd07:53:432
325359987,1cyclictest743-21snmpd11:54:042
325359987,1cyclictest741-21lldpd10:36:352
325359986,2cyclictest743-21snmpd11:40:572
325359986,2cyclictest743-21snmpd09:53:212
325359986,2cyclictest743-21snmpd08:53:432
325359986,2cyclictest743-21snmpd07:39:312
325309988,0cyclictest743-21snmpd10:12:421
325309988,0cyclictest741-21lldpd10:55:401
325309986,2cyclictest743-21snmpd10:44:041
325309986,2cyclictest743-21snmpd09:26:591
325309986,2cyclictest743-21snmpd09:21:291
325309986,2cyclictest27003-21cat12:10:141
325309985,3cyclictest743-21snmpd12:32:561
325389977,0cyclictest743-21snmpd11:37:543
325389977,0cyclictest743-21snmpd09:51:423
325389977,0cyclictest743-21snmpd09:18:473
325389977,0cyclictest741-21lldpd12:05:413
325389977,0cyclictest741-21lldpd10:58:423
325389976,1cyclictest743-21snmpd07:15:043
325389976,1cyclictest741-21lldpd12:10:373
325389976,1cyclictest573-21in:imuxsock08:33:093
325389976,1cyclictest522-21avahi-daemon11:30:123
325389976,1cyclictest506-21systemd-resolve10:30:523
325389976,1cyclictest244-20systemd-journal10:46:263
325389976,1cyclictest22822-21gpgv08:05:013
325389976,1cyclictest20171-21cat10:35:163
325389975,2cyclictest743-21snmpd11:25:213
325389975,2cyclictest743-21snmpd10:29:163
325389975,2cyclictest743-21snmpd10:02:483
325389975,2cyclictest743-21snmpd08:25:303
325389975,2cyclictest743-21snmpd07:39:403
325359977,0cyclictest743-21snmpd12:04:042
325359977,0cyclictest743-21snmpd11:59:282
325359977,0cyclictest743-21snmpd09:02:582
325359977,0cyclictest741-21lldpd11:34:082
325359977,0cyclictest741-21lldpd07:28:492
325359976,1cyclictest743-21snmpd11:24:302
325359976,1cyclictest743-21snmpd09:07:552
325359976,1cyclictest743-21snmpd08:47:342
325359976,1cyclictest743-21snmpd07:42:382
325359976,1cyclictest522-21avahi-daemon11:45:332
325359976,1cyclictest522-21avahi-daemon09:55:142
325359975,2cyclictest743-21snmpd12:29:232
325359975,2cyclictest743-21snmpd12:24:022
325359975,2cyclictest743-21snmpd12:12:162
325359975,2cyclictest743-21snmpd10:31:102
325359975,2cyclictest743-21snmpd09:15:052
325359975,2cyclictest743-21snmpd08:43:302
325359973,3cyclictest244-20systemd-journal10:59:392
325309977,0cyclictest743-21snmpd08:56:301
325309977,0cyclictest741-21lldpd11:11:141
325309977,0cyclictest741-21lldpd10:26:411
325309977,0cyclictest741-21lldpd09:35:021
325309977,0cyclictest741-21lldpd07:27:251
325309977,0cyclictest30347-21sendmail12:20:001
325309976,1cyclictest743-21snmpd10:15:261
325309976,1cyclictest741-21lldpd11:45:401
325309976,1cyclictest741-21lldpd11:01:131
325309976,1cyclictest6235-21fschecks_time11:20:161
325309976,1cyclictest522-21avahi-daemon07:40:131
325309976,1cyclictest27554-21cpuspeed_turbos08:15:131
325309975,2cyclictest743-21snmpd08:44:241
325309975,2cyclictest3609-21cat08:35:151
325309972,5cyclictest557-21NetworkManager09:06:271
325309970,0cyclictest0-21swapper/112:30:001
325389966,0cyclictest741-21lldpd08:07:033
325389966,0cyclictest741-21lldpd07:55:553
325389966,0cyclictest522-21avahi-daemon11:12:153
325389965,1cyclictest743-21snmpd08:50:253
325389965,1cyclictest743-21snmpd08:47:523
325389965,1cyclictest244-20systemd-journal08:12:243
325389965,1cyclictest22622-21cpuspeed_turbos12:00:123
325389964,2cyclictest743-21snmpd12:31:293
325389964,2cyclictest743-21snmpd12:24:113
325389964,2cyclictest743-21snmpd10:18:493
325389964,2cyclictest743-21snmpd10:07:423
325389964,2cyclictest743-21snmpd07:14:283
325389961,3cyclictest31404-21cat08:25:013
325359965,1cyclictest743-21snmpd10:18:072
325359965,1cyclictest743-21snmpd08:38:012
325359965,1cyclictest743-21snmpd08:02:092
325359965,1cyclictest522-21avahi-daemon12:07:562
325359965,1cyclictest2789-21cat07:15:162
325359964,2cyclictest743-21snmpd11:19:242
325359964,2cyclictest743-21snmpd10:20:132
325359962,3cyclictest28674-21sed09:35:222
325359962,3cyclictest13272-21ntpq11:35:202
325309966,0cyclictest741-21lldpd07:35:231
325309966,0cyclictest21481-21latency_hist10:40:001
325309966,0cyclictest13421-21cpuspeed_turbos09:00:131
325309965,1cyclictest741-21lldpd08:23:051
325309964,2cyclictest743-21snmpd12:22:231
325309964,2cyclictest743-21snmpd07:46:441
325309963,3cyclictest15535-21sed10:25:011
325389954,1cyclictest743-21snmpd11:42:273
325389954,1cyclictest27554-21cpuspeed_turbos08:15:133
325389953,2cyclictest743-21snmpd07:24:193
325389952,3cyclictest557-21NetworkManager12:25:063
325389952,2cyclictest422-21sshd09:46:003
325389950,4cyclictest23036-21ntpq10:40:193
325359955,0cyclictest743-21snmpd12:19:592
325359955,0cyclictest741-21lldpd07:49:092
325359955,0cyclictest741-21lldpd07:13:322
325359955,0cyclictest522-21avahi-daemon10:11:142
325359955,0cyclictest522-21avahi-daemon10:05:462
325359955,0cyclictest522-21avahi-daemon08:31:392
325359954,1cyclictest28194-21ntpq08:15:172
325359954,1cyclictest11334-21cpuspeed_turbos08:55:122
325359953,2cyclictest743-21snmpd08:10:502
325359953,2cyclictest32642-21sed08:25:212
325359951,3cyclictest23204-21find10:40:202
325359951,3cyclictest17486-21df_inode09:10:142
325309955,0cyclictest522-21avahi-daemon08:10:571
325309954,1cyclictest741-21lldpd08:04:291
325309954,1cyclictest573-21in:imuxsock08:30:571
325309954,1cyclictest4456-21cpuspeed_turbos07:20:121
325309954,1cyclictest19794-21irqstats09:15:161
325309953,2cyclictest717-21ntpd09:55:391
325309952,3cyclictest26173-21ntpq09:30:161
325309952,2cyclictest4447-21wc11:15:151
325309952,2cyclictest32718-21apt-get07:10:121
325309952,2cyclictest32526-21grep11:05:141
325309952,2cyclictest23270-21ntp_kernel_err12:00:161
325309952,2cyclictest1371-21cut09:50:141
325309951,3cyclictest30502-21grep09:40:211
325309950,4cyclictest32235-21ntpq09:45:171
325239950,4cyclictest6686-21fw_conntrack07:25:130
325389943,1cyclictest511ktimers/311:00:173
325389942,2cyclictest557-21NetworkManager09:05:153
325389941,2cyclictest4352-21cat11:15:143
325389941,2cyclictest3864-21ldconfig09:55:183
325389941,2cyclictest3478-21gltestperf08:35:153
325389941,2cyclictest14347-21needreboot10:20:153
325389940,4cyclictest30195-21ntpq09:40:173
325389940,3cyclictest5380-21diskstats08:40:133
325389940,3cyclictest29420-21ntp_states12:15:163
325389940,3cyclictest26237-21ntp_states09:30:173
325389940,3cyclictest17705-21grep09:10:163
325359942,2cyclictest743-21snmpd11:05:082
325359942,2cyclictest743-21snmpd07:33:232
325359942,2cyclictest25855-21sshd10:48:572
325359942,2cyclictest25830-21cat09:30:142
325359942,1cyclictest24140-21ld09:25:182
325359941,2cyclictest29992-21uname08:20:152
325359941,2cyclictest18967-21basename07:55:122
325359940,4cyclictest16417-21ntpq10:25:162
325359940,3cyclictest5194-21/usr/sbin/munin10:00:152
325359940,3cyclictest4347-21seq07:20:042
325309941,2cyclictest7410-21fschecks_count08:45:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional