You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-09 - 23:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Thu Jul 09, 2026 12:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9783992828,0cyclictest12054-21fwupd11:10:400
9783991918,1cyclictest65850irq/126-lan08:45:110
9783991817,1cyclictest65850irq/126-lan11:45:010
9783991817,1cyclictest65850irq/126-lan11:25:150
9783991817,1cyclictest65850irq/126-lan08:55:150
9783991817,1cyclictest65850irq/126-lan07:50:150
9783991817,1cyclictest65850irq/126-lan07:30:120
9783991717,0cyclictest65850irq/126-lan12:00:010
9783991717,0cyclictest65850irq/126-lan10:00:240
9783991717,0cyclictest65850irq/126-lan09:10:210
9783991717,0cyclictest65850irq/126-lan07:15:140
9783991716,1cyclictest65850irq/126-lan12:25:180
9783991716,1cyclictest65850irq/126-lan11:40:120
9783991716,1cyclictest65850irq/126-lan10:55:160
9783991716,1cyclictest65850irq/126-lan10:10:190
9783991716,1cyclictest65850irq/126-lan08:15:200
9783991716,1cyclictest65850irq/126-lan07:10:130
9783991616,0cyclictest65850irq/126-lan12:35:010
9783991616,0cyclictest65850irq/126-lan11:02:250
9783991616,0cyclictest65850irq/126-lan10:40:120
9783991616,0cyclictest65850irq/126-lan09:55:160
9783991616,0cyclictest65850irq/126-lan09:52:230
9783991616,0cyclictest65850irq/126-lan07:55:150
9783991616,0cyclictest65850irq/126-lan07:45:110
9783991615,1cyclictest65850irq/126-lan12:20:130
9783991615,1cyclictest65850irq/126-lan11:20:110
9783991615,1cyclictest65850irq/126-lan08:00:180
9783991515,0cyclictest65850irq/126-lan11:50:190
9783991515,0cyclictest65850irq/126-lan07:38:250
9783991514,1cyclictest65850irq/126-lan12:18:020
9783991514,1cyclictest65850irq/126-lan11:30:150
9783991514,1cyclictest65850irq/126-lan10:20:210
9783991514,1cyclictest65850irq/126-lan09:47:250
9783991514,1cyclictest65850irq/126-lan08:28:250
9783991514,1cyclictest65850irq/126-lan07:25:160
9783991514,1cyclictest65850irq/126-lan07:20:140
9783991414,0cyclictest65850irq/126-lan11:15:150
9783991414,0cyclictest65850irq/126-lan10:50:150
9783991414,0cyclictest65850irq/126-lan10:25:160
9783991414,0cyclictest65850irq/126-lan10:05:100
9783991414,0cyclictest65850irq/126-lan09:34:590
9783991414,0cyclictest65850irq/126-lan09:05:200
9783991414,0cyclictest65850irq/126-lan09:00:020
9783991414,0cyclictest65850irq/126-lan08:40:200
9783991414,0cyclictest65850irq/126-lan08:14:410
9783991413,1cyclictest65850irq/126-lan12:10:140
9783991413,1cyclictest65850irq/126-lan12:05:130
9783991413,1cyclictest65850irq/126-lan11:35:120
9783991413,1cyclictest65850irq/126-lan09:20:220
9783991413,1cyclictest65850irq/126-lan08:50:220
9796991313,0cyclictest9414-21cat12:25:152
9796991313,0cyclictest743-21snmpd10:24:482
9783991313,0cyclictest65850irq/126-lan10:35:240
9783991313,0cyclictest65850irq/126-lan09:15:010
9783991313,0cyclictest65850irq/126-lan08:20:000
9783991312,1cyclictest65850irq/126-lan11:55:110
9783991312,1cyclictest65850irq/126-lan08:35:160
9783991312,1cyclictest65850irq/126-lan08:30:190
9796991212,0cyclictest743-21snmpd09:35:082
9796991212,0cyclictest743-21snmpd07:36:402
9783991212,0cyclictest65850irq/126-lan11:05:160
9783991212,0cyclictest65850irq/126-lan09:41:240
9783991212,0cyclictest65850irq/126-lan09:30:110
9783991212,0cyclictest65850irq/126-lan09:25:180
9783991211,1cyclictest65850irq/126-lan12:30:120
9796991111,0cyclictest743-21snmpd12:24:082
9796991111,0cyclictest743-21snmpd11:48:072
9796991111,0cyclictest743-21snmpd11:10:292
9796991111,0cyclictest743-21snmpd09:43:562
9796991111,0cyclictest743-21snmpd07:22:092
9783991110,1cyclictest65850irq/126-lan10:30:170
9783991110,1cyclictest65850irq/126-lan10:16:560
9783991110,1cyclictest65850irq/126-lan07:40:140
9796991010,0cyclictest743-21snmpd12:15:112
9796991010,0cyclictest743-21snmpd12:12:202
9796991010,0cyclictest743-21snmpd11:35:182
9796991010,0cyclictest743-21snmpd11:30:092
9796991010,0cyclictest743-21snmpd11:07:382
9796991010,0cyclictest743-21snmpd10:39:572
9796991010,0cyclictest743-21snmpd08:34:172
9796991010,0cyclictest743-21snmpd08:16:312
9796991010,0cyclictest743-21snmpd07:47:222
9796991010,0cyclictest743-21snmpd07:41:452
9796991010,0cyclictest743-21snmpd07:31:422
9796991010,0cyclictest743-21snmpd07:19:242
9796991010,0cyclictest497-21cat10:45:152
9796991010,0cyclictest13863-21cat12:35:132
978399109,1cyclictest65850irq/126-lan08:05:130
98019998,1cyclictest743-21snmpd12:29:043
98019998,1cyclictest743-21snmpd08:33:293
97969999,0cyclictest743-21snmpd12:03:012
97969999,0cyclictest743-21snmpd11:50:132
97969999,0cyclictest743-21snmpd10:41:342
97969999,0cyclictest743-21snmpd10:18:582
97969999,0cyclictest743-21snmpd09:56:242
97969999,0cyclictest743-21snmpd08:21:142
97969999,0cyclictest743-21snmpd08:02:252
97969999,0cyclictest743-21snmpd07:11:412
97969999,0cyclictest2618-21cat09:30:132
97969999,0cyclictest13126-21cat11:15:152
97889998,1cyclictest743-21snmpd08:08:531
98019988,0cyclictest743-21snmpd11:52:013
98019988,0cyclictest743-21snmpd10:11:063
98019988,0cyclictest741-21lldpd12:11:243
98019988,0cyclictest741-21lldpd11:11:443
98019988,0cyclictest741-21lldpd10:20:213
98019987,1cyclictest743-21snmpd09:08:133
98019987,1cyclictest743-21snmpd08:55:393
98019987,1cyclictest741-21lldpd12:18:233
98019987,1cyclictest741-21lldpd09:27:483
98019987,0cyclictest191rcu_preempt11:45:213
98019986,2cyclictest743-21snmpd10:15:183
98019986,2cyclictest743-21snmpd09:38:143
98019986,2cyclictest743-21snmpd07:32:303
98019986,2cyclictest743-21snmpd07:27:083
98019986,2cyclictest743-21snmpd07:11:263
98019981,5cyclictest24622-21df_inode10:25:123
98019981,5cyclictest16896-21diskstats11:25:133
98019981,5cyclictest14839-21ntpq07:20:183
98019981,4cyclictest644-21ntpq08:05:173
98019981,3cyclictest8523-21chrt12:22:493
98019981,3cyclictest31003-21ntp_kernel_pll_08:00:173
98019980,5cyclictest2703-21ld08:10:163
98019980,4cyclictest1605-21ntpq12:05:153
97969988,0cyclictest743-21snmpd12:30:292
97969988,0cyclictest743-21snmpd07:59:122
97969988,0cyclictest741-21lldpd11:59:382
97969987,1cyclictest741-21lldpd11:02:302
97969986,2cyclictest743-21snmpd09:27:172
97969986,2cyclictest743-21snmpd09:21:012
97969986,2cyclictest743-21snmpd08:39:362
97889988,0cyclictest743-21snmpd09:30:561
97889988,0cyclictest741-21lldpd10:26:371
97889988,0cyclictest741-21lldpd09:15:031
97889986,2cyclictest743-21snmpd09:02:361
97889986,2cyclictest743-21snmpd07:25:081
97889986,2cyclictest10718-21cat09:50:141
97839987,1cyclictest65850irq/126-lan10:45:150
98019977,0cyclictest743-21snmpd10:35:453
98019977,0cyclictest741-21lldpd12:39:033
98019977,0cyclictest741-21lldpd10:09:433
98019976,1cyclictest743-21snmpd11:31:003
98019976,1cyclictest743-21snmpd07:38:163
98019975,2cyclictest743-21snmpd09:04:453
98019975,2cyclictest743-21snmpd08:50:333
98019975,2cyclictest743-21snmpd07:59:393
98019974,3cyclictest743-21snmpd07:40:123
98019972,3cyclictest874-21ntpq10:45:173
98019971,5cyclictest13455-21chrt08:37:063
98019971,4cyclictest7320-21chrt08:21:013
98019971,4cyclictest32624-21users12:00:193
98019971,4cyclictest25790-21taskset07:48:373
98019971,4cyclictest15006-21fw_conntrack11:20:123
98019971,4cyclictest10254-21taskset11:08:243
98019971,3cyclictest9488-21chrt08:27:583
98019971,3cyclictest557-21NetworkManager11:00:373
98019971,2cyclictest31375-21ntpq10:40:173
98019971,2cyclictest30257-21chrt11:56:163
98019971,2cyclictest13552-21awk09:55:213
98019971,2cyclictest11736-21taskset09:51:363
98019970,5cyclictest4724-21collect208:15:183
98019970,5cyclictest2888-21ntp_192.168.11409:30:143
98019970,4cyclictest0-21swapper/308:40:173
98019970,3cyclictest26722-21fschecks_count09:10:133
98019970,3cyclictest12056-21cat07:15:123
97969977,0cyclictest743-21snmpd09:04:122
97969977,0cyclictest741-21lldpd11:40:162
97969977,0cyclictest741-21lldpd11:20:022
97969976,1cyclictest26477-21gltestperf07:50:142
97969975,2cyclictest743-21snmpd10:00:062
97889977,0cyclictest743-21snmpd11:59:341
97889977,0cyclictest743-21snmpd11:48:011
97889977,0cyclictest743-21snmpd11:39:161
97889977,0cyclictest743-21snmpd09:37:231
97889977,0cyclictest743-21snmpd07:48:251
97889977,0cyclictest741-21lldpd10:55:041
97889977,0cyclictest741-21lldpd09:24:061
97889977,0cyclictest741-21lldpd08:31:031
97889977,0cyclictest741-21lldpd07:54:251
97889976,1cyclictest743-21snmpd12:37:001
97889976,1cyclictest743-21snmpd10:15:091
97889976,1cyclictest743-21snmpd10:03:151
97889976,1cyclictest741-21lldpd07:37:091
97889976,1cyclictest522-21avahi-daemon11:24:551
97889975,2cyclictest743-21snmpd11:14:511
97889975,2cyclictest743-21snmpd11:04:291
97889975,2cyclictest28638-21cat07:55:131
98019966,0cyclictest743-21snmpd09:24:473
98019961,3cyclictest26470-21apt-get10:30:103
98019961,3cyclictest16166-21diskstats08:45:113
98019961,3cyclictest11830-21ntpq12:30:173
98019961,2cyclictest5619-21chrt10:55:203
98019961,1cyclictest8966-21ntpq09:45:173
98019961,1cyclictest26992-21ld07:50:173
98019960,5cyclictest7268-21mailstats09:40:193
98019960,4cyclictest0-21swapper/311:40:183
98019960,3cyclictest22263-21taskset11:37:103
98019960,3cyclictest15033-21ld10:00:153
98019960,2cyclictest2906-21ld10:50:173
98019960,2cyclictest13449-21ntpq11:15:173
97969966,0cyclictest743-21snmpd08:40:212
97969966,0cyclictest743-21snmpd08:09:502
97969965,1cyclictest8636-21gltestperf09:45:152
97969965,1cyclictest743-21snmpd10:08:512
97969962,3cyclictest5349-21ld10:55:162
97969962,3cyclictest18491-21df10:10:122
97889966,0cyclictest743-21snmpd12:13:141
97889966,0cyclictest743-21snmpd10:33:221
97889966,0cyclictest743-21snmpd09:26:261
97889966,0cyclictest741-21lldpd10:36:281
97889966,0cyclictest741-21lldpd10:12:571
97889966,0cyclictest741-21lldpd10:05:161
97889966,0cyclictest522-21avahi-daemon08:03:251
97889966,0cyclictest522-21avahi-daemon07:30:261
97889964,2cyclictest743-21snmpd09:41:441
97889964,2cyclictest743-21snmpd08:16:221
97889964,2cyclictest743-21snmpd07:40:211
97889964,2cyclictest743-21snmpd07:16:151
97889963,3cyclictest557-21NetworkManager07:20:301
97889962,3cyclictest17284-21memory11:25:151
98019951,1cyclictest29223-21ntp_192.168.11409:15:173
97969955,0cyclictest741-21lldpd08:46:512
97969954,1cyclictest1597-21ntpq12:05:152
97969953,2cyclictest717-21ntpd09:53:492
97969953,2cyclictest717-21ntpd07:28:382
97969953,2cyclictest18157-21dpkg08:50:002
97969952,2cyclictest25018-21load10:25:152
97969952,2cyclictest244-20systemd-journal08:13:302
97969951,3cyclictest29878-21vmstat09:15:232
97969951,3cyclictest26796-21fw_conntrack09:10:132
97969951,3cyclictest25328-21ntp_states09:05:182
97969951,3cyclictest2303-21df10:50:122
97969950,4cyclictest21256-21ntpq08:55:162
97889955,0cyclictest522-21avahi-daemon08:44:391
97889955,0cyclictest19078-21gltestperf11:30:141
97889955,0cyclictest0-21swapper/107:10:141
97889954,1cyclictest743-21snmpd11:53:221
97889954,1cyclictest743-21snmpd11:08:411
97889954,1cyclictest743-21snmpd08:23:411
97889954,1cyclictest30589-21cpuspeed_turbos10:40:111
97889954,1cyclictest26935-21cat09:10:141
97889954,1cyclictest0-21swapper/112:05:161
97889953,2cyclictest743-21snmpd12:03:551
97889952,3cyclictest557-21NetworkManager08:49:581
97889952,3cyclictest2983-21sshd10:50:181
97889952,3cyclictest12126-21sed12:30:201
97889952,2cyclictest9881-21pmu-power12:25:181
97889952,2cyclictest8611-21netstat08:25:171
97889952,2cyclictest32530-21apt-get10:45:121
97889952,2cyclictest25270-21ntp_kernel_pll_09:05:171
97889952,2cyclictest19053-21cat08:50:161
97889951,3cyclictest7287-21grep12:20:131
97889951,3cyclictest23341-21memory11:40:141
97889951,3cyclictest23015-21missed_timers10:20:161
97969941,2cyclictest27100-21grep10:30:152
97969941,2cyclictest17055-21grep11:25:142
97969940,3cyclictest8662-21ntpq08:25:172
97889942,2cyclictest8916-21strings09:45:171
97889942,2cyclictest13176-21sed08:35:211
97889941,2cyclictest5720-21ld12:15:181
97889941,2cyclictest13136-21irqstats11:15:151
97889941,2cyclictest12282-21apt09:55:111
97889940,4cyclictest2708-21ntpq08:10:171
97889940,3cyclictest20616-21diskstats08:55:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional