You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-04 - 23:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sat Jul 04, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450350,0irq/25-eth10-21swapper/306:46:183
2123723526,0sleep20-21swapper/206:46:192
2126423324,0sleep10-21swapper/106:46:381
2144522622,0sleep00-21swapper/006:48:410
339960,0migration/328151-21cpu10:36:003
339960,0migration/327733-21sh08:55:383
339960,0migration/32245-21sh12:19:433
339960,0migration/320319-21munin-node10:10:593
29715060,0irq/26-eth0-rx-4842-21iostat_ios10:21:043
29715060,0irq/26-eth0-rx-30965-21kthreadcore10:16:063
216979960,0cyclictest19868-21diskmemload11:34:132
216959960,0cyclictest0-21swapper/109:01:001
216949960,0cyclictest0-21swapper/011:37:400
149960,0migration/05978-21irqrtprio07:51:030
149960,0migration/027132-21sh11:14:570
149960,0migration/025687-21sh11:31:140
149960,0migration/020379-21sh09:10:580
149960,0migration/018833-21sh10:28:320
149960,0migration/016428-21unixbench_multi07:31:100
149960,0migration/010619-21sh11:03:420
8215050,0irq/24-0000:00:9320-21latency_hist07:05:482
339950,0migration/35705-21kthreadcore09:41:013
339950,0migration/33769-21munin-node11:01:003
339950,0migration/33596-21kthreadcore08:36:053
339950,0migration/331569-21irqcore07:46:033
339950,0migration/331510-21kthreadcore09:56:053
339950,0migration/331138-21kthreadcore09:16:043
339950,0migration/330699-21kthreadcore08:56:033
339950,0migration/330053-21kthreadcore09:36:043
339950,0migration/32974-21latency_hist12:00:473
339950,0migration/328651-21hwlatdetect10:56:023
339950,0migration/327481-21latency_hist11:35:473
339950,0migration/326562-21kthreadcore07:16:053
339950,0migration/32471-21kthreadcore08:11:043
339950,0migration/323060-21kthreadcore10:31:043
339950,0migration/319717-21taskset08:49:213
339950,0migration/318229-21taskset10:47:113
339950,0migration/318065-21runrttasks11:27:273
339950,0migration/316880-21taskset07:35:173
339950,0migration/316600-21kthreadcore09:46:053
339950,0migration/315834-21kthreadcore12:06:063
339950,0migration/315834-21kthreadcore12:06:063
339950,0migration/314974-21munin-node07:06:073
339950,0migration/314380-21kthreadcore11:46:043
339950,0migration/311715-21runrttasks10:05:383
339950,0migration/31092-21kthreadcore07:21:053
29725050,0irq/27-eth0-tx-3849-21cat09:00:472
29725050,0irq/27-eth0-tx-3075-21munin-node12:01:052
29725050,0irq/27-eth0-tx-29138-21perl09:16:002
29725050,0irq/27-eth0-tx-28585-21munin-node06:56:080
29725050,0irq/27-eth0-tx-28249-21munin-node09:56:002
29725050,0irq/27-eth0-tx-1515-21ssh11:57:122
29725050,0irq/27-eth0-tx-0-21swapper/211:01:512
29725050,0irq/27-eth0-tx-0-21swapper/210:54:102
29725050,0irq/27-eth0-tx-0-21swapper/210:24:162
29725050,0irq/27-eth0-tx-0-21swapper/210:16:162
29725050,0irq/27-eth0-tx-0-21swapper/209:20:582
29725050,0irq/27-eth0-tx-0-21swapper/209:11:102
29725050,0irq/27-eth0-tx-0-21swapper/208:52:262
29715050,0irq/26-eth0-rx-8677-21kthreadcore09:21:043
29715050,0irq/26-eth0-rx-5233-21irqrtprio09:01:033
29715050,0irq/26-eth0-rx-28101-21grep11:55:593
29715050,0irq/26-eth0-rx-23866-21kthreadcore09:31:033
29715050,0irq/26-eth0-rx-21469-21ssh09:51:033
29715050,0irq/26-eth0-rx-18002-21sendmail_mailqu09:26:083
29715050,0irq/26-eth0-rx-0-21swapper/311:51:043
29715050,0irq/26-eth0-rx-0-21swapper/311:24:563
29715050,0irq/26-eth0-rx-0-21swapper/311:05:553
29715050,0irq/26-eth0-rx-0-21swapper/310:52:063
29715050,0irq/26-eth0-rx-0-21swapper/310:41:053
29715050,0irq/26-eth0-rx-0-21swapper/310:28:183
29715050,0irq/26-eth0-rx-0-21swapper/309:10:523
29715050,0irq/26-eth0-rx-0-21swapper/309:06:043
259950,0migration/28640-21latency11:41:042
259950,0migration/23164-21taskset09:39:132
259950,0migration/230762-21kthreadcore12:16:032
259950,0migration/228925-21irqrtprio11:16:042
259950,0migration/225759-21missed_timers09:31:052
259950,0migration/224418-21kthreadcore06:51:062
259950,0migration/223698-21latency_hist07:40:482
259950,0migration/222891-21aten_r1power_en07:15:592
259950,0migration/218869-21gltestperf08:01:032
259950,0migration/218437-21taskset12:09:162
259950,0migration/218437-21taskset12:09:162
259950,0migration/214084-21kthreadcore08:21:042
259950,0migration/212302-21aten_r1power_en09:25:582
249950,0watchdog/228451-21fschecks_count10:36:012
249950,0watchdog/228148-21munin-node08:55:582
249950,0watchdog/216735-21munin-node11:46:052
216979955,0cyclictest0-21swapper/209:06:012
216979954,0cyclictest0-21swapper/207:41:022
216959955,0cyclictest19868-21diskmemload09:14:521
216959955,0cyclictest0-21swapper/108:11:101
216959950,0cyclictest0-21swapper/110:08:001
216959950,0cyclictest0-21swapper/109:21:581
216959950,0cyclictest0-21swapper/109:06:591
216949955,0cyclictest0-21swapper/009:00:190
216949950,0cyclictest0-21swapper/012:11:520
216949950,0cyclictest0-21swapper/012:01:000
216949950,0cyclictest0-21swapper/010:55:340
216949950,0cyclictest0-21swapper/009:44:280
216949950,0cyclictest0-21swapper/009:06:190
19150,0ktimersoftd/10-21swapper/110:34:371
19150,0ktimersoftd/10-21swapper/108:58:261
179950,0migration/12898-21timerandwakeup07:21:111
179950,0migration/128479-21aten_r1power_cu09:15:581
179950,0migration/127943-21latency_hist08:55:471
179950,0migration/122421-21fschecks_count06:51:021
179950,0migration/121353-21kthreadcore10:51:041
179950,0migration/119525-21kthreadcore08:01:061
179950,0migration/115851-21kthreadcore09:46:051
179950,0migration/114715-21kthreadcore11:26:041
179950,0migration/112423-21munin-node08:41:091
179950,0migration/111141-21latency_hist12:05:471
179950,0migration/111141-21latency_hist12:05:471
169950,0watchdog/15895-21kthreadcore09:41:021
169950,0watchdog/129964-21cut11:16:051
149950,0migration/07153-21kthreadcore11:21:050
149950,0migration/05149-21irqrtprio10:01:030
149950,0migration/04464-21ksmtuned07:49:400
149950,0migration/04409-21sh10:41:010
149950,0migration/0416-21pmu-power12:16:060
149950,0migration/031279-21kthreadcore09:16:040
149950,0migration/030405-21munin-node07:21:030
149950,0migration/030132-21kthreadcore08:31:050
149950,0migration/028813-21kthreadcore11:56:020
149950,0migration/028575-21gltestperf10:56:010
149950,0migration/025699-21kthreadcore07:16:040
149950,0migration/024965-21ntp_offset11:51:070
149950,0migration/02137-21kthreadcore08:36:040
149950,0migration/021344-21irqrtprio08:51:040
149950,0migration/021316-21kthreadcore08:01:060
149950,0migration/018276-21kthreadcore08:46:050
149950,0migration/017979-21taskset11:27:120
149950,0migration/014259-21kthreadcore11:06:050
149950,0migration/012514-21irqcore11:46:030
149950,0migration/012151-21aten_r1power_fr10:06:010
149950,0migration/011303-21pmu-power08:16:070
149950,0migration/010019-21sh11:42:470
8215040,0irq/24-0000:00:31397-21cat08:10:472
339940,0migration/39379-21kthreadcore07:51:043
339940,0migration/38756-21kthreadcore07:26:053
339940,0migration/35731-21latency_hist08:15:473
339940,0migration/329243-21fschecks_time06:56:023
339940,0migration/325689-21diskmemload11:31:143
339940,0migration/312054-21latency08:41:053
29725040,0irq/27-eth0-tx-8957-21ssh11:21:062
29725040,0irq/27-eth0-tx-4043-21munin-node09:40:582
29725040,0irq/27-eth0-tx-2905-21aten2.4-expect07:00:580
29725040,0irq/27-eth0-tx-19868-21diskmemload11:51:342
29725040,0irq/27-eth0-tx-18854-21ssh10:08:092
29725040,0irq/27-eth0-tx-12061-21ssh09:45:482
29725040,0irq/27-eth0-tx-0-21swapper/211:35:572
29725040,0irq/27-eth0-tx-0-21swapper/211:25:562
29725040,0irq/27-eth0-tx-0-21swapper/210:45:482
29725040,0irq/27-eth0-tx-0-21swapper/210:41:002
29725040,0irq/27-eth0-tx-0-21swapper/210:25:542
29725040,0irq/27-eth0-tx-0-21swapper/210:11:402
29725040,0irq/27-eth0-tx-0-21swapper/008:21:000
29725040,0irq/27-eth0-tx-0-21swapper/007:11:020
29715040,0irq/26-eth0-rx-25462-21smartctl11:11:093
29715040,0irq/26-eth0-rx-25332-21grep07:41:043
29715040,0irq/26-eth0-rx-0-21swapper/312:11:143
29715040,0irq/26-eth0-rx-0-21swapper/311:42:353
29715040,0irq/26-eth0-rx-0-21swapper/311:17:503
29715040,0irq/26-eth0-rx-0-21swapper/310:06:353
29715040,0irq/26-eth0-rx-0-21swapper/308:01:003
29715040,0irq/26-eth0-rx-0-21swapper/307:55:593
29715040,0irq/26-eth0-rx-0-21swapper/307:11:013
29715040,0irq/26-eth0-rx-0-21swapper/306:51:433
259940,0migration/26104-21kthreadcore07:26:052
259940,0migration/232256-21kthreadcore07:21:052
259940,0migration/230722-21cpuspeed_turbos07:46:002
259940,0migration/228216-21kthreadcore08:06:042
259940,0migration/224443-21kthreadcore09:51:042
259940,0migration/22437-21runrttasks06:59:252
259940,0migration/223904-21kthreadcore12:11:042
259940,0migration/223022-21kthreadcore11:11:052
259940,0migration/215190-21kthreadcore07:56:052
259940,0migration/21413-21kthreadcore08:36:042
249940,0watchdog/228588-21gltestperf10:56:012
216979943,0cyclictest7406-21kthreadcore10:01:042
216979943,0cyclictest3514-21snmpd11:06:012
216979943,0cyclictest3514-21snmpd08:16:012
216979943,0cyclictest3514-21snmpd07:51:012
216979943,0cyclictest3514-21snmpd07:31:162
216979943,0cyclictest3514-21snmpd07:13:012
216979943,0cyclictest3514-21snmpd07:01:012
216979943,0cyclictest20812-21awk10:31:012
216979943,0cyclictest20061-21awk08:26:032
216959943,0cyclictest984-21awk08:36:031
216959943,0cyclictest4806-21awk10:01:011
216959943,0cyclictest3514-21snmpd12:16:011
216959943,0cyclictest3514-21snmpd12:13:311
216959943,0cyclictest3514-21snmpd11:08:311
216959943,0cyclictest3514-21snmpd11:05:311
216959943,0cyclictest3514-21snmpd10:36:311
216959943,0cyclictest3514-21snmpd10:29:311
216959943,0cyclictest3514-21snmpd08:47:161
216959943,0cyclictest3514-21snmpd07:27:311
216959943,0cyclictest3514-21snmpd07:19:311
216959943,0cyclictest3514-21snmpd07:01:311
216959943,0cyclictest3514-21snmpd06:57:311
216959943,0cyclictest3221-21sadc11:00:471
216959943,0cyclictest31382-21awk07:46:021
216959943,0cyclictest29097-21awk10:16:041
216959943,0cyclictest20130-21cut08:26:041
216949943,0cyclictest3514-21snmpd09:40:160
216949943,0cyclictest3241-21irqbalance09:20:560
216949943,0cyclictest3241-21irqbalance09:00:560
216949943,0cyclictest21130-21awk09:51:020
216949943,0cyclictest12222-21awk12:06:040
216949943,0cyclictest12222-21awk12:06:040
179940,0migration/18768-21kthreadcore10:41:061
179940,0migration/16618-21idleruntime08:16:011
179940,0migration/15917-21kthreadcore12:01:031
179940,0migration/131183-21taskset08:10:291
179940,0migration/127539-21kthreadcore08:31:041
179940,0migration/126500-21taskset09:51:391
179940,0migration/119512-21aten_r1power_po11:50:581
179940,0migration/117468-21irqrtprio07:11:041
179940,0migration/116669-21kthreadcore09:26:051
179940,0migration/114162-21kthreadcore07:56:051
179940,0migration/113903-21kthreadcore11:46:041
179940,0migration/113665-21kthreadcore07:06:061
179940,0migration/110973-21taskset07:52:361
169940,0watchdog/16559-21runrttasks09:57:091
169940,0watchdog/12950-21ssh09:38:381
169940,0watchdog/126618-21ssh09:31:381
169940,0watchdog/122800-21kthreadcore11:11:051
169940,0watchdog/121808-21kthreadcore07:36:061
169940,0watchdog/11290-21yum11:36:131
169940,0watchdog/112375-21perl10:46:011
169940,0watchdog/10-21swapper/111:24:091
169940,0watchdog/10-21swapper/110:15:331
149940,0migration/09977-21ksmtuned07:27:400
149940,0migration/032723-21kthreadcore10:36:060
149940,0migration/028432-21kthreadcore08:06:050
149940,0migration/022974-21kthreadcore10:31:040
149940,0migration/022054-21kthreadcore07:36:060
8215030,0irq/24-0000:00:0-21swapper/208:40:472
29715030,0irq/26-eth0-rx-0-21swapper/308:05:593
29715030,0irq/26-eth0-rx-0-21swapper/307:35:543
29715030,0irq/26-eth0-rx-0-21swapper/307:00:583
216979932,0cyclictest3514-21snmpd08:46:012
216979932,0cyclictest28858-21kthreadcore08:31:052
216959933,0cyclictest0-21swapper/107:30:491
216959932,0cyclictest19792-21cpuspeed_turbos11:30:591
216959932,0cyclictest13410-21awk08:21:031
216959931,0cyclictest0-21swapper/107:41:051
216959930,0cyclictest4459-21tune2fs10:21:021
216959930,0cyclictest3067-21ls11:40:471
216949933,0cyclictest27810-21kworker/0:210:46:000
216949933,0cyclictest27810-21kworker/0:210:16:050
216949933,0cyclictest27810-21kworker/0:210:11:410
216949933,0cyclictest27810-21kworker/0:209:55:510
216949933,0cyclictest27810-21kworker/0:209:45:590
216949933,0cyclictest27810-21kworker/0:208:11:030
216949933,0cyclictest20436-21kworker/0:011:16:080
216949932,0cyclictest3241-21irqbalance06:50:560
216949932,0cyclictest21302-21awk09:31:010
216949932,0cyclictest11492-21munin-node07:56:030
216949931,0cyclictest6369-21kthreadcore10:21:050
216949930,0cyclictest12880-21perl09:26:010
216949930,0cyclictest0-21swapper/008:41:040
216949930,0cyclictest0-21swapper/008:26:060
216949930,0cyclictest0-21swapper/007:41:010
216949930,0cyclictest0-21swapper/007:06:000
169930,0watchdog/10-21swapper/111:57:051
29715020,0irq/26-eth0-rx-0-21swapper/308:30:593
29715020,0irq/26-eth0-rx-0-21swapper/308:25:553
29715020,0irq/26-eth0-rx-0-21swapper/308:21:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional