You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-10 - 14:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Tue Mar 10, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1148023726,0sleep30-21swapper/306:59:243
1166123521,0sleep00-21swapper/007:01:290
1160023425,0sleep20-21swapper/207:00:432
1139223223,0sleep10-21swapper/106:58:211
117609999,0cyclictest21596-21sensors08:42:080
4160,0ktimersoftd/00-21swapper/011:32:030
339960,0migration/3627-21sh09:54:373
339960,0migration/35827-21sh11:57:383
339960,0migration/35255-21taskset12:17:263
339960,0migration/324358-21sh09:47:303
339960,0migration/322738-21sh11:27:373
339960,0migration/319014-21munin-node07:27:123
339960,0migration/315328-21sh11:45:283
29725060,0irq/27-eth0-tx-27298-21munin-node08:02:000
29725060,0irq/27-eth0-tx-21612-21munin-node08:21:590
29715060,0irq/26-eth0-rx-6547-21yum11:17:113
29715060,0irq/26-eth0-rx-31234-21vmstat10:52:103
29715060,0irq/26-eth0-rx-25890-21diskstats10:31:593
29715060,0irq/26-eth0-rx-24017-21aten2.4-expect11:51:563
29715060,0irq/26-eth0-rx-0-21swapper/311:34:583
29715060,0irq/26-eth0-rx-0-21swapper/310:22:083
149960,0migration/0968-21sh10:16:180
149960,0migration/08030-21sh10:18:180
149960,0migration/013632-21sh12:02:100
117629960,0cyclictest0-21swapper/212:00:092
8215050,0irq/24-0000:00:15775-21crond11:46:462
35150,0ktimersoftd/30-21swapper/309:42:143
339950,0migration/39398-21kthreadcore12:02:033
339950,0migration/38273-21munin-node07:47:023
339950,0migration/37986-21taskset08:11:123
339950,0migration/36038-21kthreadcore08:32:033
339950,0migration/35260-21kthreadcore10:37:063
339950,0migration/35016-21kthreadcore09:37:013
339950,0migration/331682-21kthreadcore08:27:053
339950,0migration/331623-21kthreadcore08:02:043
339950,0migration/329843-21fschecks_time08:51:593
339950,0migration/325553-21cpuspeed_turbos07:11:583
339950,0migration/325217-21fschecks_count11:12:013
339950,0migration/323052-21kthreadcore07:57:053
339950,0migration/318610-21kthreadcore12:07:043
339950,0migration/317712-21latency_hist10:06:473
339950,0migration/316903-21munin-node11:06:573
339950,0migration/316705-21kthreadcore07:52:043
339950,0migration/315674-21runrttasks11:25:213
339950,0migration/314359-21kthreadcore09:02:043
339950,0migration/312292-21kthreadcore10:02:043
339950,0migration/310641-21cpu09:21:583
29725050,0irq/27-eth0-tx-31998-21munin-node07:17:000
29725050,0irq/27-eth0-tx-31567-21ssh10:53:052
29725050,0irq/27-eth0-tx-14909-21ssh11:02:102
29725050,0irq/27-eth0-tx-0-21swapper/008:34:030
29725050,0irq/27-eth0-tx-0-21swapper/008:29:020
29715050,0irq/26-eth0-rx-6559-21runrttasks11:47:223
29715050,0irq/26-eth0-rx-32717-21ssh09:12:333
29715050,0irq/26-eth0-rx-3031-21kthreadcore11:37:043
29715050,0irq/26-eth0-rx-22662-21netstat10:47:073
29715050,0irq/26-eth0-rx-21314-21cut09:27:043
29715050,0irq/26-eth0-rx-19317-21kthreadcore10:27:033
29715050,0irq/26-eth0-rx-11945-21cut08:37:053
29715050,0irq/26-eth0-rx-0-21swapper/312:29:073
29715050,0irq/26-eth0-rx-0-21swapper/312:23:493
29715050,0irq/26-eth0-rx-0-21swapper/311:03:283
29715050,0irq/26-eth0-rx-0-21swapper/310:58:093
29715050,0irq/26-eth0-rx-0-21swapper/310:15:183
29715050,0irq/26-eth0-rx-0-21swapper/309:11:443
27150,0ktimersoftd/20-21swapper/209:26:382
259950,0migration/227394-21sh09:12:032
259950,0migration/225980-21sh09:31:102
259950,0migration/222727-21sh12:10:272
179950,0migration/115398-21fschecks_count08:17:011
169950,0watchdog/13834-21grep09:37:011
149950,0migration/09927-21kthreadcore08:12:030
149950,0migration/0711-21sh10:36:440
149950,0migration/05301-21kthreadcore09:17:040
149950,0migration/04470-21kthreadcore08:07:030
149950,0migration/03566-21kthreadcore09:57:030
149950,0migration/031027-21taskset11:12:330
149950,0migration/028476-21kthreadcore09:12:040
149950,0migration/027419-21kthreadcore08:47:050
149950,0migration/024925-21taskset07:10:140
149950,0migration/024834-21taskset10:09:490
149950,0migration/021690-21kthreadcore11:07:030
149950,0migration/019839-21kernelversion09:27:040
149950,0migration/019676-21aten_r1power_cu07:31:570
149950,0migration/017721-21taskset09:25:200
149950,0migration/014938-21sh11:02:150
149950,0migration/014882-21latency_hist08:16:470
149950,0migration/013006-21kthreadcore09:02:040
149950,0migration/010826-21irqcore10:02:030
149950,0migration/010779-21kthreadcore11:42:030
117629955,0cyclictest0-21swapper/211:16:282
117629955,0cyclictest0-21swapper/211:10:202
117629955,0cyclictest0-21swapper/209:18:522
117629954,0cyclictest3514-21snmpd08:27:062
117629950,0cyclictest0-21swapper/210:04:442
117629950,0cyclictest0-21swapper/210:00:292
117629950,0cyclictest0-21swapper/209:06:432
117619955,0cyclictest10036-21diskmemload11:55:031
117619955,0cyclictest0-21swapper/111:27:091
117619955,0cyclictest0-21swapper/110:58:461
117619955,0cyclictest0-21swapper/109:02:061
117619954,0cyclictest3514-21snmpd09:53:211
117619950,0cyclictest0-21swapper/111:46:141
117619950,0cyclictest0-21swapper/111:19:071
117609950,0cyclictest0-21swapper/010:48:040
339940,0migration/3823-21irqrtprio07:17:043
339940,0migration/326431-21diskmemload09:31:503
339940,0migration/325618-21kthreadcore08:22:033
339940,0migration/324991-21kthreadcore08:47:043
339940,0migration/32447-21kthreadcore07:42:033
339940,0migration/321212-21kthreadcore07:07:053
339940,0migration/318529-21kthreadcore08:42:043
339940,0migration/310122-21latency_hist09:01:473
29725040,0irq/27-eth0-tx-7587-21ssh10:38:002
29725040,0irq/27-eth0-tx-21744-21ssh12:29:032
29725040,0irq/27-eth0-tx-1655-21if_eth1.210:57:012
29725040,0irq/27-eth0-tx-10036-21diskmemload10:46:522
29725040,0irq/27-eth0-tx-0-21swapper/212:21:592
29725040,0irq/27-eth0-tx-0-21swapper/212:16:492
29725040,0irq/27-eth0-tx-0-21swapper/211:42:032
29725040,0irq/27-eth0-tx-0-21swapper/211:33:392
29725040,0irq/27-eth0-tx-0-21swapper/211:22:582
29725040,0irq/27-eth0-tx-0-21swapper/211:16:582
29725040,0irq/27-eth0-tx-0-21swapper/210:42:132
29725040,0irq/27-eth0-tx-0-21swapper/210:42:132
29725040,0irq/27-eth0-tx-0-21swapper/210:27:562
29725040,0irq/27-eth0-tx-0-21swapper/210:22:062
29725040,0irq/27-eth0-tx-0-21swapper/210:17:512
29725040,0irq/27-eth0-tx-0-21swapper/210:11:522
29725040,0irq/27-eth0-tx-0-21swapper/209:42:022
29725040,0irq/27-eth0-tx-0-21swapper/209:37:232
29725040,0irq/27-eth0-tx-0-21swapper/209:31:492
29725040,0irq/27-eth0-tx-0-21swapper/209:06:582
29725040,0irq/27-eth0-tx-0-21swapper/007:56:590
29725040,0irq/27-eth0-tx-0-21swapper/007:27:040
29725040,0irq/27-eth0-tx-0-21swapper/007:12:070
29715040,0irq/26-eth0-rx-0-21swapper/312:13:443
29715040,0irq/26-eth0-rx-0-21swapper/310:41:563
29715040,0irq/26-eth0-rx-0-21swapper/310:41:563
29715040,0irq/26-eth0-rx-0-21swapper/310:16:533
29715040,0irq/26-eth0-rx-0-21swapper/309:57:413
29715040,0irq/26-eth0-rx-0-21swapper/309:16:583
259940,0migration/25914-21latency07:42:042
259940,0migration/232524-21aten_r1power_po11:36:582
259940,0migration/225735-21kthreadcore11:52:022
259940,0migration/223273-21kthreadcore07:07:062
259940,0migration/219796-21kthreadcore11:27:042
259940,0migration/213597-21munin-node08:12:052
259940,0migration/210073-21kthreadcore12:02:032
249940,0watchdog/225844-21kthreadcore07:57:052
249940,0watchdog/225148-21ntp_states07:32:052
249940,0watchdog/20-21swapper/208:51:572
179940,0migration/18915-21sh09:18:331
179940,0migration/14182-21kthreadcore07:17:051
179940,0migration/127311-21switchtime08:22:081
179940,0migration/126883-21fschecks_count09:12:001
179940,0migration/126629-21kthreadcore12:12:031
179940,0migration/126382-21munin-node07:36:581
179940,0migration/125406-21fschecks_time11:12:011
179940,0migration/124719-21kthreadcore07:57:051
179940,0migration/120062-21taskset07:52:421
179940,0migration/11777-21aten_r1power_fr09:56:581
179940,0migration/11266-21kthreadcore12:17:031
179940,0migration/110144-21kthreadcore07:47:041
169940,0watchdog/16909-21memory10:17:051
169940,0watchdog/129326-21aten_r1power_po08:51:571
169940,0watchdog/127753-21kthreadcore08:47:051
169940,0watchdog/124688-21ssh09:07:531
169940,0watchdog/12419-21if_err_eth1.308:07:011
169940,0watchdog/117511-21ssh09:24:411
169940,0watchdog/116746-21ssh10:04:331
169940,0watchdog/112356-21kthreadcore08:37:051
169940,0watchdog/10-21swapper/111:57:041
169940,0watchdog/10-21swapper/111:26:411
169940,0watchdog/10-21swapper/111:09:171
169940,0watchdog/10-21swapper/111:04:051
169940,0watchdog/10-21swapper/109:47:571
169940,0watchdog/10-21swapper/107:27:061
149940,0migration/08998-21runrttasks09:39:230
149940,0migration/05805-21sh12:19:030
149940,0migration/027990-21kthreadcore11:52:030
149940,0migration/021566-21kthreadcore10:27:030
149940,0migration/016144-21ksmtuned10:23:330
149940,0migration/012684-21kthreadcore10:42:020
149940,0migration/012684-21kthreadcore10:42:020
149940,0migration/012561-21kthreadcore09:42:030
149940,0migration/010494-21kthreadcore11:22:020
117629943,0cyclictest3514-21snmpd10:31:512
117629943,0cyclictest3514-21snmpd09:52:512
117629943,0cyclictest3514-21snmpd09:46:512
117629943,0cyclictest3514-21snmpd08:56:512
117629943,0cyclictest3241-21irqbalance08:47:052
117629943,0cyclictest3241-21irqbalance08:42:152
117629943,0cyclictest3241-21irqbalance08:37:252
117629943,0cyclictest3241-21irqbalance08:32:152
117629943,0cyclictest3241-21irqbalance08:22:252
117629943,0cyclictest3241-21irqbalance08:09:262
117629943,0cyclictest3241-21irqbalance08:01:562
117629943,0cyclictest3241-21irqbalance07:52:462
117629943,0cyclictest3241-21irqbalance07:49:062
117629943,0cyclictest3241-21irqbalance07:21:562
117629943,0cyclictest3241-21irqbalance07:17:162
117629943,0cyclictest3241-21irqbalance07:14:262
117629943,0cyclictest3241-21irqbalance07:02:462
117629943,0cyclictest27214-21awk07:37:022
117629943,0cyclictest24326-21awk12:12:002
117629943,0cyclictest18652-21awk10:06:592
117629943,0cyclictest15868-21awk08:17:032
117629943,0cyclictest13888-21awk07:27:032
117619944,0cyclictest0-21swapper/112:08:561
117619944,0cyclictest0-21swapper/110:32:461
117619944,0cyclictest0-21swapper/108:11:491
117619944,0cyclictest0-21swapper/107:01:581
117619943,0cyclictest8518-21awk12:02:021
117619943,0cyclictest4573-21awk08:57:021
117619943,0cyclictest3556-21lldpd12:29:411
117619943,0cyclictest3556-21lldpd12:23:411
117619943,0cyclictest3556-21lldpd07:35:361
117619943,0cyclictest3556-21lldpd07:12:061
117619943,0cyclictest3514-21snmpd10:12:511
117619943,0cyclictest3514-21snmpd09:41:511
117619943,0cyclictest3514-21snmpd08:45:061
117619943,0cyclictest3514-21snmpd08:01:511
117619943,0cyclictest3514-21snmpd07:44:361
117619943,0cyclictest3514-21snmpd07:25:211
117619943,0cyclictest3241-21irqbalance10:21:551
117619943,0cyclictest3241-21irqbalance09:26:551
117619943,0cyclictest29250-21awk08:27:031
117619943,0cyclictest27399-21awk09:32:021
117619943,0cyclictest25216-21sadc10:31:471
117619943,0cyclictest24465-21basename11:31:571
117619943,0cyclictest16907-21awk11:46:591
117609944,0cyclictest0-21swapper/012:13:310
117609943,0cyclictest7785-21sadc11:41:460
117609943,0cyclictest3241-21irqbalance11:30:550
117609943,0cyclictest3241-21irqbalance09:09:550
117609943,0cyclictest26040-21awk10:52:010
117609943,0cyclictest24244-21kworker/0:012:23:400
117609943,0cyclictest1921-21awk10:37:030
117609943,0cyclictest15936-21awk12:27:010
117609943,0cyclictest1581-21awk10:57:010
117609943,0cyclictest1518-21awk07:42:020
117609943,0cyclictest1268-21awk11:17:010
117609940,0cyclictest0-21swapper/012:07:410
29725030,0irq/27-eth0-tx-0-21swapper/008:37:000
29715030,0irq/26-eth0-rx-0-21swapper/308:17:073
29715030,0irq/26-eth0-rx-0-21swapper/308:11:593
29715030,0irq/26-eth0-rx-0-21swapper/307:21:593
29715030,0irq/26-eth0-rx-0-21swapper/307:03:073
169930,0watchdog/17078-21ssh11:39:411
169930,0watchdog/110036-21diskmemload10:51:531
169930,0watchdog/10-21swapper/110:47:011
169930,0watchdog/10-21swapper/110:42:131
169930,0watchdog/10-21swapper/110:42:131
169930,0watchdog/10-21swapper/110:37:011
169930,0watchdog/10-21swapper/107:07:021
117619932,0cyclictest18781-21awk10:06:591
117619930,0cyclictest3297-21hddtemp_smartct08:32:001
117609933,0cyclictest16248-21kworker/0:111:57:000
117609933,0cyclictest16248-21kworker/0:111:47:020
117609933,0cyclictest16248-21kworker/0:109:51:500
117609933,0cyclictest16248-21kworker/0:109:47:020
117609933,0cyclictest16248-21kworker/0:109:32:040
117609933,0cyclictest16248-21kworker/0:108:57:020
117609933,0cyclictest16248-21kworker/0:108:51:560
117609933,0cyclictest16248-21kworker/0:107:52:410
117609933,0cyclictest16248-21kworker/0:107:46:530
117609933,0cyclictest16248-21kworker/0:107:36:510
117609933,0cyclictest16248-21kworker/0:107:21:590
117609933,0cyclictest16248-21kworker/0:107:02:010
29715020,0irq/26-eth0-rx-0-21swapper/307:36:583
29715020,0irq/26-eth0-rx-0-21swapper/307:32:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional