You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-23 - 12:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Thu Jul 23, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450550,0irq/25-eth10-21swapper/318:47:303
301424645,0sleep00-21swapper/018:44:240
358823423,0sleep20-21swapper/218:46:382
365423324,0sleep10-21swapper/118:47:251
38819966,0cyclictest1979-21diskmemload23:35:592
38819966,0cyclictest0-21swapper/223:31:532
35160,0ktimersoftd/30-21swapper/323:06:123
339960,0migration/38486-21sh22:59:313
339960,0migration/37562-21sh21:51:493
339960,0migration/3517-21sh00:00:393
339960,0migration/317827-21sh22:24:573
339960,0migration/316013-21runrttasks21:58:313
339960,0migration/313533-21munin-node20:29:253
339960,0migration/311791-21aten_r1power_en19:19:133
29715060,0irq/26-eth0-rx-31396-21sh22:07:153
29715060,0irq/26-eth0-rx-23665-21open_files23:09:223
29715060,0irq/26-eth0-rx-16317-21users20:54:263
149960,0migration/08806-21sh23:22:390
149960,0migration/02105-21sh22:37:330
149960,0migration/019910-21latency20:34:190
149960,0migration/012745-21irqrtprio22:24:180
8215050,0irq/24-0000:00:16687-21cat23:49:012
38819955,0cyclictest0-21swapper/222:24:532
38819950,0cyclictest0-21swapper/222:57:592
38759954,0cyclictest0-21swapper/020:04:160
339950,0migration/39782-21diskmemload22:19:343
339950,0migration/37963-21sh21:31:033
339950,0migration/35080-21munin-node18:49:173
339950,0migration/3318-21timerandwakeup20:19:243
339950,0migration/330169-21kthreadcore23:34:193
339950,0migration/327575-21munin-node22:54:183
339950,0migration/325614-21taskset19:51:523
339950,0migration/324307-21munin-node22:49:203
339950,0migration/324157-21sh00:14:553
339950,0migration/323245-21kthreadcore20:39:173
339950,0migration/322771-21pmu-power21:39:213
339950,0migration/32196-21fschecks_time23:19:163
339950,0migration/321273-21kthreadcore22:29:183
339950,0migration/319904-21kthreadcore21:59:193
339950,0migration/319462-21munin-node23:54:143
339950,0migration/318002-21cpu21:19:143
339950,0migration/317657-21sh23:52:013
339950,0migration/316311-21pmu-power18:54:223
339950,0migration/315125-21munin-node23:24:213
339950,0migration/313906-21kthreadcore22:44:183
339950,0migration/312026-21kthreadcore21:14:193
29725050,0irq/27-eth0-tx-8996-21ssh21:12:072
29725050,0irq/27-eth0-tx-8320-21ssh21:32:092
29725050,0irq/27-eth0-tx-588-21ssh00:00:522
29725050,0irq/27-eth0-tx-5047-21munin-node19:14:180
29725050,0irq/27-eth0-tx-1979-21diskmemload22:11:002
29725050,0irq/27-eth0-tx-19362-21munin-node19:49:250
29725050,0irq/27-eth0-tx-19003-21kthreadcore21:59:192
29725050,0irq/27-eth0-tx-17148-21munin-node21:39:212
29725050,0irq/27-eth0-tx-15278-21ssh00:09:182
29725050,0irq/27-eth0-tx-1341-21idleruntime21:49:172
29725050,0irq/27-eth0-tx-1081-21munin-node23:39:122
29725050,0irq/27-eth0-tx-0-21swapper/223:46:302
29725050,0irq/27-eth0-tx-0-21swapper/223:12:202
29725050,0irq/27-eth0-tx-0-21swapper/221:47:022
29725050,0irq/27-eth0-tx-0-21swapper/221:25:312
29725050,0irq/27-eth0-tx-0-21swapper/221:04:082
29725050,0irq/27-eth0-tx-0-21swapper/019:47:560
29715050,0irq/26-eth0-rx-7262-21kthreadcore20:49:193
29715050,0irq/26-eth0-rx-2191-21cpuspeed_turbos21:09:153
29715050,0irq/26-eth0-rx-13726-21aten_r1power_en20:09:143
29715050,0irq/26-eth0-rx-10298-21ssh22:43:063
29715050,0irq/26-eth0-rx-0-21swapper/323:29:183
29715050,0irq/26-eth0-rx-0-21swapper/323:14:473
29715050,0irq/26-eth0-rx-0-21swapper/322:34:173
29715050,0irq/26-eth0-rx-0-21swapper/322:13:193
29715050,0irq/26-eth0-rx-0-21swapper/321:44:183
29715050,0irq/26-eth0-rx-0-21swapper/321:00:373
29715050,0irq/26-eth0-rx-0-21swapper/300:11:023
29715050,0irq/26-eth0-rx-0-21swapper/300:08:273
259950,0migration/2436-21irqrtprio19:34:192
259950,0migration/23777-21kthreadcore22:59:192
259950,0migration/23430-21kthreadcore23:19:192
259950,0migration/229371-21kthreadcore23:14:192
259950,0migration/226401-21kthreadcore19:29:182
259950,0migration/222842-21needreboot18:59:202
259950,0migration/222398-21kthreadcore21:19:192
259950,0migration/218998-21missed_timers20:09:212
259950,0migration/215396-21switchtime23:24:242
249950,0watchdog/26379-21cut22:39:192
249950,0watchdog/210436-21cpu23:04:152
179950,0migration/19272-21kthreadcore20:04:191
179950,0migration/15443-21taskset19:35:251
179950,0migration/14416-21taskset19:09:321
179950,0migration/13320-21kthreadcore23:39:161
179950,0migration/126655-21missed_timers20:39:191
179950,0migration/126083-21taskset22:30:541
179950,0migration/121039-21kthreadcore18:59:191
179950,0migration/12094-21sh22:37:301
179950,0migration/120600-21kthreadcore22:49:181
179950,0migration/120396-21kthreadcore23:09:191
179950,0migration/120069-21kthreadcore21:59:191
179950,0migration/118628-21cpuspeed_turbos19:24:151
179950,0migration/117332-21kthreadcore19:44:201
169950,0watchdog/14193-21kthreadcore21:09:201
169950,0watchdog/12672-21rm22:17:151
169950,0watchdog/11979-21diskmemload22:39:191
149950,0migration/09866-21kthreadcore19:39:190
149950,0migration/07609-21taskset21:51:570
149950,0migration/06783-21kthreadcore18:49:190
149950,0migration/05896-21munin-node19:59:200
149950,0migration/05074-21kthreadcore20:49:180
149950,0migration/04863-21kthreadcore21:09:200
149950,0migration/032073-21taskset23:36:150
149950,0migration/02988-21sh22:18:130
149950,0migration/029415-21kthreadcore21:24:180
149950,0migration/027409-21taskset20:40:090
149950,0migration/027124-21kthreadcore21:44:180
149950,0migration/024943-21latency_hist19:29:020
149950,0migration/024062-21munin-node23:54:190
149950,0migration/017068-21sh23:50:120
149950,0migration/016804-21munin-node22:44:230
149950,0migration/01201-21sendmail_mailtr20:44:280
149950,0migration/011691-21latency_hist19:19:020
149950,0migration/011629-21kthreadcore23:24:180
149950,0migration/010281-21kthreadcore20:29:210
38819943,0cyclictest3556-21lldpd20:24:472
38819943,0cyclictest3556-21lldpd20:24:472
38819943,0cyclictest3514-21snmpd19:39:292
38819943,0cyclictest3241-21irqbalance22:20:302
38819943,0cyclictest26906-21awk19:54:162
38819943,0cyclictest19644-21awk22:49:162
38819943,0cyclictest19527-21awk23:54:152
38819940,0cyclictest0-21swapper/220:06:562
38779943,0cyclictest3556-21lldpd20:00:171
38779943,0cyclictest3514-21snmpd22:09:141
38779943,0cyclictest3514-21snmpd20:23:291
38779943,0cyclictest3514-21snmpd19:49:291
38779943,0cyclictest3514-21snmpd19:31:291
38779943,0cyclictest3514-21snmpd19:23:291
38779943,0cyclictest3514-21snmpd18:52:131
38779943,0cyclictest3514-21snmpd00:01:001
38779943,0cyclictest2908-21awk00:04:141
38779943,0cyclictest19460-21awk23:54:141
38779943,0cyclictest12381-21awk22:24:171
38759943,0cyclictest4491-21awk22:19:140
38759943,0cyclictest3556-21lldpd21:23:170
38759943,0cyclictest3514-21snmpd21:05:440
38759943,0cyclictest3514-21snmpd20:57:140
38759943,0cyclictest25488-21sadc00:19:010
38759943,0cyclictest2217-21awk20:24:140
38759943,0cyclictest2217-21awk20:24:140
38759943,0cyclictest14674-21awk20:09:180
38759943,0cyclictest11115-21awk23:04:180
38759943,0cyclictest10873-21awk00:09:150
38759943,0cyclictest10188-21awk21:34:180
339940,0migration/37245-21kthreadcore19:14:193
339940,0migration/34743-21kthreadcore19:59:173
339940,0migration/34595-21kthreadcore20:24:163
339940,0migration/34595-21kthreadcore20:24:163
339940,0migration/330217-21taskset19:05:343
339940,0migration/327493-21kthreadcore21:24:183
339940,0migration/325784-21hddtemp_smartct19:29:153
339940,0migration/324626-21kthreadcore20:14:203
29725040,0irq/27-eth0-tx-9895-21ssh21:14:132
29725040,0irq/27-eth0-tx-8562-21munin-node21:54:162
29725040,0irq/27-eth0-tx-0-21swapper/222:46:272
29725040,0irq/27-eth0-tx-0-21swapper/222:35:242
29725040,0irq/27-eth0-tx-0-21swapper/222:14:062
29725040,0irq/27-eth0-tx-0-21swapper/222:04:282
29725040,0irq/27-eth0-tx-0-21swapper/221:34:392
29725040,0irq/27-eth0-tx-0-21swapper/200:14:142
29725040,0irq/27-eth0-tx-0-21swapper/020:17:170
29725040,0irq/27-eth0-tx-0-21swapper/019:34:210
29715040,0irq/26-eth0-rx-1834-21munin-node23:39:153
29715040,0irq/26-eth0-rx-0-21swapper/323:44:173
29715040,0irq/26-eth0-rx-0-21swapper/322:14:503
29715040,0irq/26-eth0-rx-0-21swapper/321:34:303
29715040,0irq/26-eth0-rx-0-21swapper/321:04:143
259940,0migration/29591-21ntp_offset18:49:212
259940,0migration/27079-21kthreadcore00:04:172
259940,0migration/26291-21kthreadcore20:49:192
259940,0migration/232284-21kthreadcore19:09:182
259940,0migration/228632-21kthreadcore19:04:192
259940,0migration/226254-21kthreadcore20:39:182
259940,0migration/224636-21runrttasks19:27:262
259940,0migration/224461-21kthreadcore20:14:202
259940,0migration/222596-21kthreadcore19:49:192
259940,0migration/215094-21kthreadcore20:54:202
259940,0migration/212667-21latency_hist19:44:022
249940,0watchdog/28060-21aten2.4-expect20:29:162
249940,0watchdog/223542-21kthreadcore20:59:202
249940,0watchdog/20-21swapper/222:29:152
249940,0watchdog/20-21swapper/220:34:202
179940,0migration/19697-21runrttasks23:44:171
179940,0migration/18996-21kthreadcore19:39:191
179940,0migration/13377-21irqcore22:59:181
179940,0migration/131830-21switchtime23:14:251
179940,0migration/131720-21switchtime19:54:241
179940,0migration/129403-21munin-node19:04:191
179940,0migration/129003-21kthreadcore21:04:191
179940,0migration/128340-21kthreadcore23:34:191
179940,0migration/128239-21kthreadcore22:54:201
179940,0migration/127616-21kthreadcore21:24:181
179940,0migration/12662-21kthreadcore20:24:151
179940,0migration/12662-21kthreadcore20:24:151
179940,0migration/126251-21kthreadcore22:04:171
179940,0migration/125568-21munin-node21:44:151
179940,0migration/12210-21kthreadcore21:49:191
179940,0migration/118804-21fschecks_time20:59:151
179940,0migration/117479-21sh23:29:121
179940,0migration/115162-21kthreadcore22:44:181
179940,0migration/115022-21kthreadcore00:09:181
179940,0migration/113446-21kthreadcore18:54:191
179940,0migration/111721-21kthreadcore23:04:201
179940,0migration/110041-21latency_hist20:54:021
169940,0watchdog/18547-21ssh23:21:511
169940,0watchdog/16751-21head21:29:201
169940,0watchdog/13514-21snmpd21:43:161
169940,0watchdog/127988-21munin-node20:44:201
169940,0watchdog/125145-21ssh00:17:591
169940,0watchdog/123514-21tr20:14:201
169940,0watchdog/117845-21kthreadcore20:09:201
169940,0watchdog/115612-21ssh21:35:121
169940,0watchdog/114748-21ssh21:54:361
169940,0watchdog/10-21swapper/122:20:231
169940,0watchdog/10-21swapper/121:19:201
169940,0watchdog/10-21swapper/120:34:201
149940,0migration/08573-21aten_r1power_cu21:54:110
149940,0migration/024782-21fschecks_time19:04:150
149940,0migration/018653-21fschecks_count20:59:150
8215030,0irq/24-0000:00:0-21swapper/220:19:022
38819933,0cyclictest11651-21awk18:54:172
38819932,0cyclictest6788-21kthreadcore19:14:192
38819932,0cyclictest3556-21lldpd20:03:172
38779932,0cyclictest3514-21snmpd23:50:301
38779932,0cyclictest3514-21snmpd19:14:291
38779932,0cyclictest3084-21awk20:49:161
38759933,0cyclictest2014-21kworker/0:119:09:130
38759933,0cyclictest2014-21kworker/0:118:59:130
38759933,0cyclictest2009-21kworker/0:223:59:120
38759933,0cyclictest2009-21kworker/0:223:44:180
38759933,0cyclictest2009-21kworker/0:223:39:100
38759933,0cyclictest2009-21kworker/0:223:29:140
38759933,0cyclictest2009-21kworker/0:223:09:140
38759933,0cyclictest2009-21kworker/0:222:59:120
38759933,0cyclictest2009-21kworker/0:222:39:090
38759933,0cyclictest2009-21kworker/0:222:29:170
38759933,0cyclictest2009-21kworker/0:222:09:050
38759933,0cyclictest2009-21kworker/0:222:04:030
38759933,0cyclictest2009-21kworker/0:221:59:090
38759933,0cyclictest2009-21kworker/0:221:39:170
38759933,0cyclictest2009-21kworker/0:221:29:070
38759933,0cyclictest2009-21kworker/0:200:04:140
38759932,0cyclictest3514-21snmpd21:14:140
38759932,0cyclictest27692-21awk22:54:190
38759932,0cyclictest27304-21cut20:19:140
38759932,0cyclictest26891-21awk19:54:160
38759932,0cyclictest22818-21kthreadcore19:24:210
38759932,0cyclictest2009-21kworker/0:222:49:020
38759930,0cyclictest0-21swapper/023:14:210
339930,0migration/328060-21aten_r1power_fr20:44:183
29725030,0irq/27-eth0-tx-0-21swapper/018:54:180
29715030,0irq/26-eth0-rx-0-21swapper/320:34:123
29715030,0irq/26-eth0-rx-0-21swapper/319:44:123
29715030,0irq/26-eth0-rx-0-21swapper/319:39:133
29715030,0irq/26-eth0-rx-0-21swapper/319:34:143
29715030,0irq/26-eth0-rx-0-21swapper/319:24:143
29715030,0irq/26-eth0-rx-0-21swapper/318:59:153
259930,0migration/215298-21kthreadcore19:19:192
249930,0watchdog/20-21swapper/220:44:202
19130,0ktimersoftd/10-21swapper/123:24:011
169930,0watchdog/10-21swapper/121:14:161
169930,0watchdog/10-21swapper/120:29:161
29715020,0irq/26-eth0-rx-0-21swapper/320:04:203
29715020,0irq/26-eth0-rx-0-21swapper/319:54:073
29715020,0irq/26-eth0-rx-0-21swapper/319:09:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional