You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-05 - 21:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sat Sep 05, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1268028381,0sleep00-21swapper/006:40:330
1283827675,0sleep20-21swapper/206:42:232
304450530,0irq/25-eth10-21swapper/306:44:043
1281722723,0sleep10-21swapper/106:42:061
131169976,0cyclictest18187-21ls09:49:470
131169970,0cyclictest3241-21irqbalance11:22:550
35160,0ktimersoftd/30-21swapper/311:41:533
35160,0ktimersoftd/30-21swapper/309:12:543
339960,0migration/39932-21taskset09:22:123
339960,0migration/37609-21sh11:03:483
339960,0migration/330854-21sh10:55:123
339960,0migration/330058-21taskset08:31:353
339960,0migration/32900-21sh08:59:143
339960,0migration/319067-21sh09:08:563
29715060,0irq/26-eth0-rx-9354-21kthreadcore12:05:053
29715060,0irq/26-eth0-rx-24779-21grep11:15:013
29715060,0irq/26-eth0-rx-21427-21ssh12:12:493
29715060,0irq/26-eth0-rx-16232-21ssh10:05:253
149960,0migration/07422-21sh10:41:250
149960,0migration/031259-21munin-node11:59:580
149960,0migration/030204-21sh11:58:420
149960,0migration/01797-21sh09:38:340
149960,0migration/014275-21munin-node07:30:090
131189966,0cyclictest0-21swapper/210:59:582
8215050,0irq/24-0000:00:14654-21perf11:49:462
339950,0migration/39428-21hddtemp_smartct07:30:023
339950,0migration/36868-21kthreadcore09:40:043
339950,0migration/33622-21kthreadcore12:00:033
339950,0migration/330245-21kthreadcore09:35:053
339950,0migration/329633-21diskmemload11:35:223
339950,0migration/326167-21munin-node10:35:003
339950,0migration/321677-21munin-node11:10:073
339950,0migration/321350-21taskset07:35:273
339950,0migration/320708-21munin-node11:50:093
339950,0migration/317317-21aten_r1power_en08:25:003
339950,0migration/316739-21sh10:49:523
339950,0migration/313515-21kthreadcore09:25:083
339950,0migration/312880-21kthreadcore08:20:043
29725050,0irq/27-eth0-tx-793-21munin-node10:40:102
29725050,0irq/27-eth0-tx-6438-21munin-node12:05:012
29725050,0irq/27-eth0-tx-26637-21munin-node06:55:082
29725050,0irq/27-eth0-tx-25969-21sshd09:10:502
29725050,0irq/27-eth0-tx-23944-21munin-node08:30:092
29725050,0irq/27-eth0-tx-23931-21ssh10:53:202
29725050,0irq/27-eth0-tx-17395-21ssh09:25:402
29725050,0irq/27-eth0-tx-16165-21munin-node11:10:032
29725050,0irq/27-eth0-tx-1607-21ssh09:59:412
29725050,0irq/27-eth0-tx-13333-21munin-node06:45:012
29725050,0irq/27-eth0-tx-11613-21munin-node08:45:012
29725050,0irq/27-eth0-tx-0-21swapper/211:28:062
29725050,0irq/27-eth0-tx-0-21swapper/210:00:592
29725050,0irq/27-eth0-tx-0-21swapper/209:18:372
29715050,0irq/26-eth0-rx-9194-21cut11:45:063
29715050,0irq/26-eth0-rx-8007-21unixbench-2d10:00:093
29715050,0irq/26-eth0-rx-32152-21cpu11:19:593
29715050,0irq/26-eth0-rx-31306-21kthreadcore07:45:043
29715050,0irq/26-eth0-rx-25834-21sh08:50:283
29715050,0irq/26-eth0-rx-21495-21grep09:50:053
29715050,0irq/26-eth0-rx-20288-21cut10:30:043
29715050,0irq/26-eth0-rx-15919-21ssh10:26:133
29715050,0irq/26-eth0-rx-1324-21sshd09:15:253
29715050,0irq/26-eth0-rx-0-21swapper/311:29:593
29715050,0irq/26-eth0-rx-0-21swapper/311:28:003
29715050,0irq/26-eth0-rx-0-21swapper/310:47:323
29715050,0irq/26-eth0-rx-0-21swapper/310:20:013
29715050,0irq/26-eth0-rx-0-21swapper/310:14:493
29715050,0irq/26-eth0-rx-0-21swapper/309:58:013
29715050,0irq/26-eth0-rx-0-21swapper/309:30:073
29715050,0irq/26-eth0-rx-0-21swapper/309:02:053
259950,0migration/23645-21fschecks_time09:20:012
259950,0migration/232471-21fschecks_count11:20:002
259950,0migration/23218-21cpuspeed_turbos07:49:582
259950,0migration/230600-21sh11:16:262
259950,0migration/229895-21kthreadcore10:55:052
259950,0migration/224034-21fschecks_time11:35:012
259950,0migration/223829-21latency_hist08:29:472
259950,0migration/222980-21munin-node07:40:042
259950,0migration/218592-21aten_r1power_po09:49:592
259950,0migration/217313-21kthreadcore11:50:042
259950,0migration/214903-21sh11:06:482
259950,0migration/212345-21kthreadcore07:55:052
249950,0watchdog/211365-21diskmemload10:36:092
19150,0ktimersoftd/10-21swapper/109:34:221
19150,0ktimersoftd/10-21swapper/107:55:031
179950,0migration/17160-21sh10:20:081
149950,0migration/09081-21timerwakeupswit09:20:100
149950,0migration/07450-21fschecks_count11:45:020
149950,0migration/06797-21df_abs12:05:000
149950,0migration/03549-21missed_timers08:35:070
149950,0migration/032305-21kthreadcore07:20:050
149950,0migration/029154-21taskset08:07:320
149950,0migration/025106-21netstat08:50:070
149950,0migration/024328-21kthreadcore07:40:050
149950,0migration/023438-21unixbench_multi10:30:100
149950,0migration/021865-21latency_hist07:39:470
149950,0migration/018973-21kthreadcore11:10:040
149950,0migration/018599-21aten_r1power_vo09:50:000
149950,0migration/018193-21kthreadcore08:00:060
149950,0migration/015638-21taskset11:09:010
149950,0migration/015592-21taskset10:47:040
149950,0migration/013510-21kthreadcore08:20:040
149950,0migration/012886-21kthreadcore10:25:060
131189955,0cyclictest0-21swapper/209:01:152
131189954,0cyclictest11308-21ps10:05:062
131189950,0cyclictest0-21swapper/209:33:152
131179955,0cyclictest0-21swapper/111:27:061
131179955,0cyclictest0-21swapper/108:55:351
131179954,0cyclictest9934-21kthreadcore12:05:061
131179950,0cyclictest0-21swapper/110:17:341
131179950,0cyclictest0-21swapper/110:00:041
131179950,0cyclictest0-21swapper/109:40:031
131179950,0cyclictest0-21swapper/106:45:121
131169955,0cyclictest0-21swapper/011:28:540
131169955,0cyclictest0-21swapper/010:35:180
131169950,0cyclictest0-21swapper/010:50:170
131169950,0cyclictest0-21swapper/010:05:020
8215040,0irq/24-0000:00:0-21swapper/206:54:482
339940,0migration/328013-21kthreadcore06:55:033
339940,0migration/327400-21kthreadcore08:05:063
339940,0migration/323008-21kthreadcore07:15:063
339940,0migration/322489-21fschecks_count07:40:023
339940,0migration/319041-21kthreadcore07:10:053
339940,0migration/313741-21taskset07:05:573
339940,0migration/310290-21taskset08:18:343
29725040,0irq/27-eth0-tx-0-21swapper/212:00:182
29725040,0irq/27-eth0-tx-0-21swapper/210:45:262
29725040,0irq/27-eth0-tx-0-21swapper/210:15:102
29725040,0irq/27-eth0-tx-0-21swapper/210:10:012
29725040,0irq/27-eth0-tx-0-21swapper/210:10:012
29725040,0irq/27-eth0-tx-0-21swapper/209:45:092
29725040,0irq/27-eth0-tx-0-21swapper/209:34:542
29725040,0irq/27-eth0-tx-0-21swapper/208:15:072
29725040,0irq/27-eth0-tx-0-21swapper/207:45:012
29715040,0irq/26-eth0-rx-0-21swapper/311:54:473
29715040,0irq/26-eth0-rx-0-21swapper/311:05:373
29715040,0irq/26-eth0-rx-0-21swapper/310:39:533
29715040,0irq/26-eth0-rx-0-21swapper/310:10:363
29715040,0irq/26-eth0-rx-0-21swapper/310:10:363
29715040,0irq/26-eth0-rx-0-21swapper/309:47:283
29715040,0irq/26-eth0-rx-0-21swapper/308:44:563
29715040,0irq/26-eth0-rx-0-21swapper/308:10:053
259940,0migration/26442-21kthreadcore08:40:042
259940,0migration/230792-21kthreadcore08:55:032
259940,0migration/227972-21kthreadcore11:55:072
259940,0migration/227332-21runrttasks07:19:022
259940,0migration/224628-21kthreadcore08:50:052
259940,0migration/21942-21fschecks_time10:20:012
259940,0migration/215912-21kthreadcore07:10:042
259940,0migration/214413-21kthreadcore10:25:062
249940,0watchdog/28093-21fschecks_count07:05:022
249940,0watchdog/23331-21sort09:40:012
249940,0watchdog/218167-21hddtemp_smartct10:30:012
249940,0watchdog/215889-21grep07:35:022
249940,0watchdog/211948-21df09:05:012
249940,0watchdog/20-21swapper/211:40:052
19140,0ktimersoftd/10-21swapper/112:00:311
179940,0migration/16108-21switchtime11:00:091
179940,0migration/129760-21timerwakeupswit08:30:101
179940,0migration/128930-21cpuspeed_turbos07:44:591
179940,0migration/123328-21fschecks_count11:55:021
179940,0migration/119505-21kthreadcore10:50:041
179940,0migration/115666-21gltestperf11:50:011
179940,0migration/114321-21kthreadcore09:05:061
169940,0watchdog/131679-21kthreadcore09:55:051
169940,0watchdog/122566-21fschecks_time07:40:021
169940,0watchdog/12214-21ssh09:18:091
169940,0watchdog/120711-21grep10:10:051
169940,0watchdog/120711-21grep10:10:051
169940,0watchdog/11257-21cut10:40:011
169940,0watchdog/11142-21tr08:10:061
169940,0watchdog/110851-21ssh09:03:291
169940,0watchdog/10-21swapper/109:25:051
169940,0watchdog/10-21swapper/109:10:571
169940,0watchdog/10-21swapper/108:45:051
169940,0watchdog/10-21swapper/108:35:051
149940,0migration/06837-21kthreadcore09:40:040
149940,0migration/05662-21kthreadcore07:25:040
149940,0migration/04692-21irqrtprio09:00:040
149940,0migration/04252-21kthreadcore10:20:040
149940,0migration/017977-21kthreadcore11:30:040
149940,0migration/017206-21latency_hist08:24:470
149940,0migration/016131-21irqrtprio11:50:030
149940,0migration/012408-21sh09:05:030
149940,0migration/01036-21sendmail_mailtr08:55:080
131189943,0cyclictest3514-21snmpd12:09:512
131189943,0cyclictest30433-21awk08:10:032
131189943,0cyclictest16522-21awk11:30:022
131189943,0cyclictest16268-21munin-node08:00:092
131179944,0cyclictest0-21swapper/111:39:521
131179944,0cyclictest0-21swapper/110:58:431
131179944,0cyclictest0-21swapper/110:28:181
131179943,0cyclictest9221-21awk11:05:031
131179943,0cyclictest8586-21awk07:05:041
131179943,0cyclictest3868-21awk07:50:011
131179943,0cyclictest3556-21lldpd12:11:101
131179943,0cyclictest3556-21lldpd11:47:101
131179943,0cyclictest3556-21lldpd11:20:401
131179943,0cyclictest3556-21lldpd08:15:401
131179943,0cyclictest3556-21lldpd08:00:401
131179943,0cyclictest3556-21lldpd06:50:101
131179943,0cyclictest3514-21snmpd11:17:521
131179943,0cyclictest3514-21snmpd10:38:511
131179943,0cyclictest3514-21snmpd09:45:211
131179943,0cyclictest3241-21irqbalance11:35:551
131179943,0cyclictest3241-21irqbalance11:31:451
131179943,0cyclictest3241-21irqbalance10:44:551
131179943,0cyclictest3241-21irqbalance09:35:051
131179943,0cyclictest3241-21irqbalance08:50:061
131179943,0cyclictest3241-21irqbalance08:39:561
131179943,0cyclictest27543-21awk06:55:011
131179943,0cyclictest21817-21awk07:15:041
131179943,0cyclictest19405-21awk09:50:031
131179943,0cyclictest18245-21awk10:30:021
131179943,0cyclictest17165-21awk11:10:031
131169944,0cyclictest0-21swapper/010:16:040
131169943,0cyclictest3556-21lldpd11:00:400
131169943,0cyclictest3556-21lldpd09:11:100
131169943,0cyclictest3556-21lldpd08:44:100
131169943,0cyclictest3514-21snmpd12:11:360
131169943,0cyclictest20176-21kworker/0:209:16:220
131169943,0cyclictest19826-21kworker/0:110:11:020
131169943,0cyclictest19826-21kworker/0:110:11:020
131169940,0cyclictest0-21swapper/008:14:470
8215030,0irq/24-0000:00:0-21swapper/208:05:032
339930,0migration/322060-21kthreadcore06:50:043
29715030,0irq/26-eth0-rx-0-21swapper/308:39:593
29715030,0irq/26-eth0-rx-0-21swapper/308:35:063
29715030,0irq/26-eth0-rx-0-21swapper/307:55:253
29715030,0irq/26-eth0-rx-0-21swapper/307:52:553
29715030,0irq/26-eth0-rx-0-21swapper/307:19:583
29715030,0irq/26-eth0-rx-0-21swapper/306:59:583
29715030,0irq/26-eth0-rx-0-21swapper/306:45:003
249930,0watchdog/20-21swapper/208:35:052
169930,0watchdog/10-21swapper/109:19:531
169930,0watchdog/10-21swapper/108:20:061
169930,0watchdog/10-21swapper/108:05:061
169930,0watchdog/10-21swapper/107:25:021
131189932,0cyclictest2010-21basename07:24:582
131189930,0cyclictest28035-21diskstats07:20:012
131189930,0cyclictest10632-21munin-node08:19:592
131189930,0cyclictest0-21swapper/207:01:072
131179933,0cyclictest0-21swapper/107:35:021
131179932,0cyclictest462-21grep07:20:061
131179932,0cyclictest1781-21awk07:00:041
131179931,0cyclictest17394-21kthreadcore07:10:051
131179930,0cyclictest9978-21munin-node10:05:081
131179930,0cyclictest17930-21perl08:25:021
131179930,0cyclictest0-21swapper/107:31:431
131169933,0cyclictest20176-21kworker/0:209:29:480
131169933,0cyclictest20176-21kworker/0:209:24:500
131169933,0cyclictest20176-21kworker/0:208:44:570
131169933,0cyclictest20176-21kworker/0:208:30:070
131169933,0cyclictest20176-21kworker/0:208:14:550
131169933,0cyclictest20176-21kworker/0:207:44:570
131169933,0cyclictest20176-21kworker/0:207:15:070
131169933,0cyclictest20176-21kworker/0:207:09:590
131169933,0cyclictest20176-21kworker/0:207:04:490
131169933,0cyclictest20176-21kworker/0:206:59:530
131169933,0cyclictest20176-21kworker/0:206:55:010
131169933,0cyclictest20176-21kworker/0:206:50:010
131169933,0cyclictest20176-21kworker/0:206:45:130
131169933,0cyclictest19826-21kworker/0:109:59:480
131169933,0cyclictest19826-21kworker/0:109:54:580
131169933,0cyclictest17138-21kworker/0:011:40:020
131169933,0cyclictest17138-21kworker/0:011:34:500
131169933,0cyclictest17138-21kworker/0:010:54:560
131169932,0cyclictest3820-21awk07:50:000
131169932,0cyclictest28162-21grep11:15:050
131169930,0cyclictest0-21swapper/007:54:580
29715020,0irq/26-eth0-rx-0-21swapper/308:00:253
29715020,0irq/26-eth0-rx-0-21swapper/307:25:063
131189921,0cyclictest8638-21date07:29:482
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional