You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-29 - 16:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Mon Jun 29, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2150626766,0sleep00-21swapper/006:49:570
2144524031,0sleep20-21swapper/206:49:142
1527123829,0sleep30-21swapper/306:46:233
2125023223,0sleep10-21swapper/106:46:571
339970,0migration/318948-21sh10:09:013
339960,0migration/326946-21sh11:56:093
339960,0migration/326922-21sh09:33:023
339960,0migration/326726-21sh08:53:003
339960,0migration/319574-21sh09:30:033
29715060,0irq/26-eth0-rx-8178-21tr12:01:343
29715060,0irq/26-eth0-rx-17940-21processes09:06:363
216919960,0cyclictest0-21swapper/209:11:412
216909960,0cyclictest0-21swapper/111:27:111
8215050,0irq/24-0000:00:27127-21munin-run11:36:152
4150,0ktimersoftd/00-21swapper/012:14:590
339950,0migration/35973-21kthreadcore11:01:333
339950,0migration/3566-21kthreadcore10:36:353
339950,0migration/3566-21kthreadcore10:36:353
339950,0migration/35321-21munin-node09:41:333
339950,0migration/35281-21kthreadcore07:26:313
339950,0migration/35115-21kthreadcore11:21:323
339950,0migration/331840-21irqrtprio07:46:333
339950,0migration/329909-21kthreadcore11:16:333
339950,0migration/329033-21taskset07:17:223
339950,0migration/32772-21munin-node07:21:393
339950,0migration/327673-21latency_hist10:56:163
339950,0migration/326304-21kthreadcore08:06:323
339950,0migration/325981-21ksmtuned10:51:493
339950,0migration/323591-21taskset07:39:273
339950,0migration/322693-21kthreadcore10:31:343
339950,0migration/32124-21kthreadcore08:11:323
339950,0migration/318599-21taskset09:47:383
339950,0migration/318307-21aten_r1power_cu08:01:273
339950,0migration/318228-21kthreadcore07:11:353
339950,0migration/315037-21kthreadcore07:56:333
339950,0migration/313650-21irqcore08:21:293
339950,0migration/311885-21aten_r1power_fr10:26:283
339950,0migration/311468-21latency_hist11:06:163
339950,0migration/31129-21irqcore08:36:333
339950,0migration/310892-21kthreadcore08:16:353
339950,0migration/310039-21runrttasks10:42:253
339950,0migration/310039-21runrttasks10:42:253
29725050,0irq/27-eth0-tx-9662-21ssh11:01:422
29725050,0irq/27-eth0-tx-3896-21munin-node10:01:332
29725050,0irq/27-eth0-tx-3041-21munin-node11:41:422
29725050,0irq/27-eth0-tx-28692-21kernelversion11:36:322
29725050,0irq/27-eth0-tx-28591-21chrt11:56:322
29725050,0irq/27-eth0-tx-26674-21ssh12:15:582
29725050,0irq/27-eth0-tx-21903-21munin-node06:51:420
29725050,0irq/27-eth0-tx-20046-21diskmemload09:03:392
29725050,0irq/27-eth0-tx-12253-21munin-node09:26:312
29725050,0irq/27-eth0-tx-11801-21munin-node10:26:372
29725050,0irq/27-eth0-tx-11012-21munin-node12:06:312
29725050,0irq/27-eth0-tx-0-21swapper/209:56:392
29725050,0irq/27-eth0-tx-0-21swapper/209:48:592
29725050,0irq/27-eth0-tx-0-21swapper/209:42:572
29725050,0irq/27-eth0-tx-0-21swapper/209:06:462
29725050,0irq/27-eth0-tx-0-21swapper/208:57:392
29725050,0irq/27-eth0-tx-0-21swapper/008:36:300
29715050,0irq/26-eth0-rx-31472-21kthreadcore09:36:333
29715050,0irq/26-eth0-rx-28609-21diskstats09:56:303
29715050,0irq/26-eth0-rx-28392-21munin-node10:16:293
29715050,0irq/26-eth0-rx-27482-21forks12:16:303
29715050,0irq/26-eth0-rx-24004-21kthreadcore11:11:343
29715050,0irq/26-eth0-rx-130582sleep308:42:383
29715050,0irq/26-eth0-rx-0-21swapper/312:12:203
29715050,0irq/26-eth0-rx-0-21swapper/312:07:513
29715050,0irq/26-eth0-rx-0-21swapper/311:58:293
29715050,0irq/26-eth0-rx-0-21swapper/311:47:033
29715050,0irq/26-eth0-rx-0-21swapper/311:39:573
29715050,0irq/26-eth0-rx-0-21swapper/311:33:473
29715050,0irq/26-eth0-rx-0-21swapper/311:27:223
29715050,0irq/26-eth0-rx-0-21swapper/310:15:093
29715050,0irq/26-eth0-rx-0-21swapper/310:03:053
29715050,0irq/26-eth0-rx-0-21swapper/309:53:263
29715050,0irq/26-eth0-rx-0-21swapper/309:21:303
29715050,0irq/26-eth0-rx-0-21swapper/309:11:353
29715050,0irq/26-eth0-rx-0-21swapper/308:57:573
29715050,0irq/26-eth0-rx-0-21swapper/306:56:343
259950,0migration/28762-21kthreadcore08:41:312
259950,0migration/229733-21munin-node09:16:322
259950,0migration/22939-21sh10:20:022
259950,0migration/228956-21munin-node06:56:302
259950,0migration/226916-21sh09:53:262
259950,0migration/22363-21taskset10:38:532
259950,0migration/22363-21taskset10:38:532
259950,0migration/221704-21kthreadcore11:11:332
259950,0migration/215168-21pmu-power07:06:352
259950,0migration/214178-21kthreadcore07:31:332
259950,0migration/210872-21latency_hist12:06:152
249950,0watchdog/25693-21kthreadcore09:21:302
249950,0watchdog/23941-21kthreadcore08:36:342
249950,0watchdog/219155-21if_err_eth108:01:312
216919955,0cyclictest0-21swapper/211:01:052
216919950,0cyclictest0-21swapper/211:30:532
216919950,0cyclictest0-21swapper/211:08:112
216909955,0cyclictest0-21swapper/109:21:131
216909955,0cyclictest0-21swapper/108:31:341
216909950,0cyclictest0-21swapper/112:06:271
216909950,0cyclictest0-21swapper/111:54:561
216909950,0cyclictest0-21swapper/109:28:191
216899955,0cyclictest0-21swapper/011:58:350
216899950,0cyclictest0-21swapper/011:44:330
216899950,0cyclictest0-21swapper/010:22:440
216899950,0cyclictest0-21swapper/010:15:480
216899950,0cyclictest0-21swapper/009:30:140
216899950,0cyclictest0-21swapper/009:23:080
179950,0migration/18411-21missed_timers12:01:351
179950,0migration/132250-21kthreadcore07:46:331
179950,0migration/125392-21unixbench_multi11:31:381
179950,0migration/122344-21kthreadcore10:31:341
179950,0migration/118531-21sh10:48:401
169950,0watchdog/19254-21kthreadcore08:16:351
149950,0migration/031565-21kthreadcore12:16:350
149950,0migration/02766-21sh11:00:150
149950,0migration/027171-21latency_hist11:36:150
149950,0migration/02433-21sh09:37:450
149950,0migration/017992-21unixbench-2d10:06:400
149950,0migration/017967-21sh11:07:330
149950,0migration/014734-21kthreadcore07:56:330
149950,0migration/013716-21kthreadcore12:06:320
149950,0migration/013490-21kthreadcore11:46:320
149950,0migration/013469-21kernelversion09:46:340
339940,0migration/330757-21kthreadcore09:16:333
339940,0migration/328258-21taskset06:55:403
339940,0migration/315570-21kthreadcore07:31:333
339940,0migration/310508-21pmu-power07:51:363
29725040,0irq/27-eth0-tx-9937-21ssh10:21:472
29725040,0irq/27-eth0-tx-11191-21munin-node11:46:272
29725040,0irq/27-eth0-tx-0-21swapper/212:19:112
29725040,0irq/27-eth0-tx-0-21swapper/211:22:182
29725040,0irq/27-eth0-tx-0-21swapper/211:16:282
29725040,0irq/27-eth0-tx-0-21swapper/210:31:292
29725040,0irq/27-eth0-tx-0-21swapper/210:11:502
29725040,0irq/27-eth0-tx-0-21swapper/210:06:252
29725040,0irq/27-eth0-tx-0-21swapper/209:36:192
29725040,0irq/27-eth0-tx-0-21swapper/008:51:290
29725040,0irq/27-eth0-tx-0-21swapper/007:01:290
29715040,0irq/26-eth0-rx-6031-21kthreadcore07:01:353
29715040,0irq/26-eth0-rx-17321-21port_sshpriv10:46:373
29715040,0irq/26-eth0-rx-0-21swapper/311:42:123
29715040,0irq/26-eth0-rx-0-21swapper/310:21:163
29715040,0irq/26-eth0-rx-0-21swapper/309:01:543
29715040,0irq/26-eth0-rx-0-21swapper/308:31:313
259940,0migration/26702-21kthreadcore10:41:312
259940,0migration/26702-21kthreadcore10:41:312
259940,0migration/25079-21kthreadcore07:01:342
259940,0migration/24883-21latency_hist07:51:162
259940,0migration/229611-21kthreadcore08:31:322
259940,0migration/227144-21kthreadcore07:41:332
259940,0migration/223322-21kthreadcore09:31:332
259940,0migration/221819-21latency_hist06:51:172
259940,0migration/221410-21kthreadcore07:36:342
259940,0migration/219762-21fschecks_count11:51:282
259940,0migration/215031-21kthreadcore08:46:332
259940,0migration/214772-21kthreadcore07:56:332
259940,0migration/213235-21kthreadcore10:46:332
249940,0watchdog/29255-21kthreadcore08:16:352
249940,0watchdog/232503-21kthreadcore07:21:352
249940,0watchdog/222016-21grep10:51:342
249940,0watchdog/217607-21kthreadcore07:11:352
216919944,0cyclictest0-21swapper/207:28:532
216919943,0cyclictest3556-21lldpd08:53:052
216919943,0cyclictest3556-21lldpd08:09:042
216919943,0cyclictest3556-21lldpd07:17:032
216919943,0cyclictest3514-21snmpd08:31:002
216919943,0cyclictest3514-21snmpd08:23:002
216909944,0cyclictest0-21swapper/109:41:241
216909944,0cyclictest0-21swapper/108:01:361
216909943,0cyclictest5052-21awk09:21:281
216909943,0cyclictest4019-21awk11:41:311
216909943,0cyclictest3844-21awk07:01:331
216909943,0cyclictest3556-21lldpd11:47:351
216909943,0cyclictest3556-21lldpd10:07:341
216909943,0cyclictest3556-21lldpd09:57:351
216909943,0cyclictest3556-21lldpd08:06:341
216909943,0cyclictest3514-21snmpd11:36:301
216909943,0cyclictest3514-21snmpd10:59:151
216909943,0cyclictest3514-21snmpd10:13:001
216909943,0cyclictest3514-21snmpd09:31:301
216909943,0cyclictest29180-21grep10:36:331
216909943,0cyclictest29180-21grep10:36:331
216909943,0cyclictest28465-21awk11:16:311
216909943,0cyclictest13077-21awk09:06:301
216909943,0cyclictest12771-21awk10:26:321
216899944,0cyclictest0-21swapper/011:30:130
216899943,0cyclictest4972-21awk09:01:320
216899943,0cyclictest4890-21awk07:26:300
216899943,0cyclictest4133-21awk11:21:300
216899943,0cyclictest3556-21lldpd09:07:050
216899943,0cyclictest3556-21lldpd08:10:340
216899943,0cyclictest3556-21lldpd08:05:030
216899943,0cyclictest3514-21snmpd10:52:000
216899943,0cyclictest3241-21irqbalance11:36:440
216899943,0cyclictest3241-21irqbalance11:17:040
216899943,0cyclictest3241-21irqbalance10:16:540
216899943,0cyclictest3241-21irqbalance07:16:350
216899943,0cyclictest3241-21irqbalance07:11:450
216899943,0cyclictest3241-21irqbalance07:07:250
216899943,0cyclictest30464-21awk07:21:320
216899943,0cyclictest29424-21awk09:16:300
216899943,0cyclictest28780-21awk10:36:320
216899943,0cyclictest28780-21awk10:36:320
216899943,0cyclictest24874-21awk07:41:310
216899943,0cyclictest20429-21awk11:11:310
216899943,0cyclictest13487-21awk08:21:280
216899940,0cyclictest13613-21munin-node08:46:300
179940,0migration/16838-21latency_hist08:41:161
179940,0migration/16042-21timerwakeupswit08:36:411
179940,0migration/129958-21kthreadcore06:56:341
179940,0migration/125209-21kthreadcore09:11:351
179940,0migration/124435-21kthreadcore08:26:341
179940,0migration/120373-21hwlatdetect11:11:311
179940,0migration/120346-21aten_r1power_en08:51:281
179940,0migration/120021-21cpuspeed_turbos10:51:281
179940,0migration/119678-21fschecks_time12:11:261
179940,0migration/112571-21latency_hist08:21:161
179940,0migration/112476-21cpuspeed_turbos09:46:291
179940,0migration/111110-21ksmtuned07:52:481
179940,0migration/11078-21taskset11:56:531
169940,0watchdog/16704-21kthreadcore10:21:341
169940,0watchdog/13896-21munin-node10:01:301
169940,0watchdog/13493-21ssh10:41:181
169940,0watchdog/13493-21ssh10:41:181
169940,0watchdog/131651-21kthreadcore10:16:341
169940,0watchdog/130915-21kthreadcore07:21:351
169940,0watchdog/127471-21diskstats12:16:301
169940,0watchdog/127239-21kthreadcore07:16:351
169940,0watchdog/120153-21ssh09:51:261
169940,0watchdog/11869-21ssh08:56:421
169940,0watchdog/10-21swapper/108:46:341
169940,0watchdog/10-21swapper/107:11:351
149940,0migration/05451-21kthreadcore11:01:320
149940,0migration/032409-21kthreadcore07:46:330
149940,0migration/031596-21kthreadcore09:56:340
149940,0migration/029771-21irqrtprio06:56:330
149940,0migration/029503-21kthreadcore08:31:320
149940,0migration/022858-21kthreadcore09:11:340
149940,0migration/021840-21kthreadcore09:31:330
149940,0migration/019859-21kthreadcore07:36:330
149940,0migration/016213-21kthreadcore10:26:340
149940,0migration/012691-21sh10:46:320
149940,0migration/012391-21munin-node08:41:340
149940,0migration/010037-21sh10:01:420
29725030,0irq/27-eth0-tx-0-21swapper/007:31:270
29715030,0irq/26-eth0-rx-0-21swapper/308:46:293
29715030,0irq/26-eth0-rx-0-21swapper/307:45:493
29715030,0irq/26-eth0-rx-0-21swapper/307:08:203
216919933,0cyclictest3556-21lldpd08:11:342
216919933,0cyclictest3556-21lldpd07:46:332
216909932,0cyclictest4279-21cat11:01:301
216909932,0cyclictest4118-21awk11:21:301
216909932,0cyclictest29192-21awk09:36:301
216909932,0cyclictest25166-21grep07:41:321
216909932,0cyclictest22883-21awk06:51:321
216909932,0cyclictest1629-21grep08:11:311
216909932,0cyclictest15048-21kthreadcore07:31:331
216909931,0cyclictest21200-21kthreadcore07:36:341
216899932,0cyclictest6518-21perl08:16:310
216899932,0cyclictest5848-21awk07:51:310
216899932,0cyclictest3514-21snmpd10:42:000
216899932,0cyclictest3514-21snmpd10:42:000
216899932,0cyclictest3514-21snmpd09:42:150
216899932,0cyclictest28894-21head08:56:310
216899932,0cyclictest25986-21munin-node10:31:440
216899932,0cyclictest22048-21kthreadcore09:51:320
216899932,0cyclictest2089-21grep08:11:320
216899932,0cyclictest20114-21awk08:26:310
179930,0migration/19563-21rt-features07:26:351
179930,0migration/113304-21kthreadcore07:06:321
169930,0watchdog/10-21swapper/111:07:461
169930,0watchdog/10-21swapper/109:01:341
169930,0watchdog/10-21swapper/107:56:271
29715020,0irq/26-eth0-rx-0-21swapper/308:26:173
216899921,0cyclictest0-21swapper/012:01:150
216899920,0cyclictest19131-21latency_hist11:51:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional