You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-17 - 19:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Mon Aug 17, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450700,0irq/25-eth10-21swapper/306:44:493
951423324,0sleep10-21swapper/106:43:381
960123223,0sleep20-21swapper/206:44:402
949523228,0sleep00-21swapper/006:43:250
98419966,0cyclictest0-21swapper/209:56:482
35160,0ktimersoftd/30-21swapper/308:52:143
339960,0migration/331666-21munin-node10:01:483
339960,0migration/330419-21sh09:38:443
339960,0migration/328216-21sh10:58:523
339960,0migration/314043-21runrttasks09:27:213
339960,0migration/310810-21sh11:27:553
29725060,0irq/27-eth0-tx-13000-21munin-node08:01:530
29725060,0irq/27-eth0-tx-11867-21port_sshpriv10:26:572
29725060,0irq/27-eth0-tx-11742-21fschecks_time12:11:482
29715060,0irq/26-eth0-rx-13080-21ssh11:31:483
29715060,0irq/26-eth0-rx-0-21swapper/311:20:573
259960,0migration/211218-21pmu-power10:46:572
179960,0migration/12907-21latency_hist12:06:351
149960,0migration/05080-21sh10:46:110
149960,0migration/02125-21sh11:42:340
98419955,0cyclictest0-21swapper/210:25:202
98419950,0cyclictest0-21swapper/208:08:202
98409953,0cyclictest17056-21awk08:51:501
98409950,0cyclictest8049-21diskmemload10:18:291
98399955,0cyclictest0-21swapper/010:27:240
98399950,0cyclictest0-21swapper/011:31:060
8215050,0irq/24-0000:00:0-21swapper/208:31:362
35150,0ktimersoftd/30-21swapper/310:26:183
339950,0migration/39727-21taskset12:08:083
339950,0migration/3948-21kthreadcore09:41:533
339950,0migration/39274-21kthreadcore07:31:523
339950,0migration/331952-21if_eth1.207:26:523
339950,0migration/331905-21kthreadcore10:41:533
339950,0migration/331637-21kthreadcore11:21:533
339950,0migration/328712-21kthreadcore08:56:533
339950,0migration/328332-21aten2.4-expect11:41:473
339950,0migration/327911-21kthreadcore10:16:553
339950,0migration/324654-21kthreadcore11:36:543
339950,0migration/32316-21kthreadcore07:51:533
339950,0migration/322054-21kthreadcore08:06:523
339950,0migration/321636-21kthreadcore11:56:513
339950,0migration/32151-21kthreadcore09:21:523
339950,0migration/315894-21runrttasks09:11:183
339950,0migration/315228-21diskmemload09:51:413
339950,0migration/314827-21kthreadcore07:36:543
339950,0migration/314614-21kthreadcore06:46:543
339950,0migration/313637-21taskset08:25:203
339950,0migration/310317-21kthreadcore09:46:553
29725050,0irq/27-eth0-tx-7301-21munin-node08:21:520
29725050,0irq/27-eth0-tx-7295-21munin-node09:46:572
29725050,0irq/27-eth0-tx-5286-21unixbench-2d09:42:002
29725050,0irq/27-eth0-tx-32001-21munin-node07:51:540
29725050,0irq/27-eth0-tx-29934-21munin-node10:41:562
29725050,0irq/27-eth0-tx-28297-21ssh10:59:072
29725050,0irq/27-eth0-tx-24267-21munin-node09:16:552
29725050,0irq/27-eth0-tx-23176-21ssh08:54:282
29725050,0irq/27-eth0-tx-10051-21munin-node06:46:490
29725050,0irq/27-eth0-tx-0-21swapper/211:02:532
29725050,0irq/27-eth0-tx-0-21swapper/210:37:042
29725050,0irq/27-eth0-tx-0-21swapper/210:03:322
29725050,0irq/27-eth0-tx-0-21swapper/209:01:552
29725050,0irq/27-eth0-tx-0-21swapper/008:36:560
29725050,0irq/27-eth0-tx-0-21swapper/007:19:210
29715050,0irq/26-eth0-rx-8705-21kthreadcore10:46:543
29715050,0irq/26-eth0-rx-639-21aten_r1power_vo08:16:493
29715050,0irq/26-eth0-rx-30166-21ssh09:59:313
29715050,0irq/26-eth0-rx-25552-21irqrtprio09:16:563
29715050,0irq/26-eth0-rx-21262-21ssh10:13:163
29715050,0irq/26-eth0-rx-1889-21chrt12:03:413
29715050,0irq/26-eth0-rx-10552-21open_files11:06:553
29715050,0irq/26-eth0-rx-0-21swapper/311:51:483
29715050,0irq/26-eth0-rx-0-21swapper/311:46:363
29715050,0irq/26-eth0-rx-0-21swapper/311:11:523
29715050,0irq/26-eth0-rx-0-21swapper/311:03:273
29715050,0irq/26-eth0-rx-0-21swapper/310:55:473
29715050,0irq/26-eth0-rx-0-21swapper/310:31:503
29715050,0irq/26-eth0-rx-0-21swapper/309:34:583
29715050,0irq/26-eth0-rx-0-21swapper/309:05:583
29715050,0irq/26-eth0-rx-0-21swapper/308:51:153
29715050,0irq/26-eth0-rx-0-21swapper/307:21:533
27150,0ktimersoftd/20-21swapper/211:50:372
259950,0migration/27809-21kthreadcore07:56:532
259950,0migration/27809-21kthreadcore07:56:532
259950,0migration/26799-21sh09:24:312
259950,0migration/25669-21kthreadcore07:06:532
259950,0migration/23069-21munin-node07:01:552
259950,0migration/230127-21timerandwakeup07:21:592
259950,0migration/226229-21timerwakeupswit11:37:002
259950,0migration/222451-21sh09:12:032
259950,0migration/219108-21munin-node07:41:502
259950,0migration/218921-21munin-node08:02:002
249950,0watchdog/230614-21kthreadcore12:01:532
249950,0watchdog/230436-21rm08:57:062
249950,0watchdog/221180-21kthreadcore07:16:542
249950,0watchdog/216102-21if_err_eth109:51:502
179950,0migration/16108-21irqcore11:06:511
179950,0migration/125327-21sh08:06:571
179950,0migration/120879-21munin-node08:31:471
179950,0migration/114157-21kthreadcore11:51:521
179950,0migration/112605-21fschecks_time07:36:501
169950,0watchdog/1967-21grep11:01:541
149950,0migration/07532-21sh09:05:340
149950,0migration/07372-21fschecks_time10:06:500
149950,0migration/07236-21kthreadcore10:46:530
149950,0migration/07129-21latency_hist09:46:350
149950,0migration/06664-21taskset08:17:090
149950,0migration/06252-21latency_hist07:56:360
149950,0migration/06252-21latency_hist07:56:360
149950,0migration/06143-21kthreadcore07:06:530
149950,0migration/0595-21kthreadcore07:01:530
149950,0migration/05080-21aten_r1power_vo11:06:460
149950,0migration/05037-21taskset07:31:180
149950,0migration/04359-21fschecks_time11:46:480
149950,0migration/031309-21taskset09:19:460
149950,0migration/030027-21fschecks_time11:01:490
149950,0migration/027125-21kthreadcore08:56:520
149950,0migration/025384-21kthreadcore10:56:510
149950,0migration/023736-21sh09:36:480
149950,0migration/02097-21kthreadcore10:01:520
149950,0migration/020916-21taskset10:12:120
149950,0migration/020853-21aten_r1power_cu11:16:460
149950,0migration/020360-21fschecks_time11:56:480
149950,0migration/020333-21ksmtuned10:32:170
149950,0migration/018918-21sh11:55:030
149950,0migration/018518-21kthreadcore08:51:520
149950,0migration/018140-21taskset07:37:580
149950,0migration/018032-21kthreadcore11:11:520
149950,0migration/016958-21cpuspeed_turbos06:51:490
149950,0migration/014367-21unixbench_multi08:47:000
149950,0migration/012706-21munin-node11:31:470
149950,0migration/012025-21kthreadcore09:26:510
149950,0migration/01082-21kernelversion09:21:510
149950,0migration/010786-21runrttasks09:46:560
98419943,0cyclictest9190-21awk08:46:522
98419943,0cyclictest8212-21awk08:21:532
98419943,0cyclictest7693-21awk10:06:522
98419943,0cyclictest3514-21snmpd07:52:492
98419943,0cyclictest3514-21snmpd07:33:342
98419943,0cyclictest3514-21snmpd07:27:342
98419943,0cyclictest3241-21irqbalance08:16:542
98419943,0cyclictest28177-21awk08:36:512
98419943,0cyclictest24521-21awk09:36:512
98419943,0cyclictest23622-21awk10:16:532
98419943,0cyclictest21544-21awk08:31:502
98419943,0cyclictest14397-21awk10:51:492
98409943,0cyclictest7626-21awk10:06:521
98409943,0cyclictest5259-21awk11:26:511
98409943,0cyclictest3556-21lldpd09:48:491
98409943,0cyclictest3514-21snmpd12:10:191
98409943,0cyclictest3514-21snmpd10:59:191
98409943,0cyclictest3514-21snmpd10:36:491
98409943,0cyclictest3514-21snmpd10:23:491
98409943,0cyclictest3514-21snmpd09:39:041
98409943,0cyclictest3514-21snmpd09:33:341
98409943,0cyclictest3514-21snmpd07:32:491
98409943,0cyclictest3514-21snmpd07:13:041
98409943,0cyclictest3514-21snmpd07:09:041
98409943,0cyclictest3514-21snmpd06:57:191
98409943,0cyclictest32087-21awk10:01:501
98409943,0cyclictest25811-21sort07:46:491
98409943,0cyclictest25204-21awk07:21:511
98409943,0cyclictest20658-21awk11:56:501
98409943,0cyclictest19546-21awk07:41:521
98409943,0cyclictest17535-21awk06:51:521
98409943,0cyclictest17473-21grep09:11:521
98399944,0cyclictest0-21swapper/012:14:270
98399943,0cyclictest3514-21snmpd10:40:340
98399943,0cyclictest3514-21snmpd09:09:340
98399943,0cyclictest27471-21ps08:11:530
98399940,0cyclictest0-21swapper/011:37:160
339940,0migration/331633-21missed_timers08:11:553
339940,0migration/327580-21kthreadcore07:46:533
339940,0migration/324817-21kthreadcore10:36:523
339940,0migration/322032-21missed_timers06:51:553
339940,0migration/317295-21interrupts09:11:523
339940,0migration/316029-21kthreadcore07:11:543
339940,0migration/315211-21irqrtprio08:26:523
339940,0migration/310059-21kthreadcore07:56:533
339940,0migration/310059-21kthreadcore07:56:533
29725040,0irq/27-eth0-tx-8049-21diskmemload12:06:412
29725040,0irq/27-eth0-tx-21894-21ssh09:32:082
29725040,0irq/27-eth0-tx-0-21swapper/211:56:362
29725040,0irq/27-eth0-tx-0-21swapper/211:32:212
29725040,0irq/27-eth0-tx-0-21swapper/211:11:452
29725040,0irq/27-eth0-tx-0-21swapper/211:08:522
29725040,0irq/27-eth0-tx-0-21swapper/210:31:422
29725040,0irq/27-eth0-tx-0-21swapper/209:06:382
29725040,0irq/27-eth0-tx-0-21swapper/008:41:580
29715040,0irq/26-eth0-rx-0-21swapper/312:11:463
29715040,0irq/26-eth0-rx-0-21swapper/310:26:563
29715040,0irq/26-eth0-rx-0-21swapper/310:06:373
29715040,0irq/26-eth0-rx-0-21swapper/308:31:463
29715040,0irq/26-eth0-rx-0-21swapper/307:46:243
29715040,0irq/26-eth0-rx-0-21swapper/307:16:543
259940,0migration/24444-21aten_r1power_vo11:26:472
259940,0migration/228027-21kthreadcore06:56:542
259940,0migration/226220-21latency_hist08:11:362
259940,0migration/222562-21kthreadcore11:16:522
259940,0migration/214946-21cpuspeed_turbos10:11:472
259940,0migration/214540-21kthreadcore11:51:522
259940,0migration/212473-21kthreadcore09:26:512
259940,0migration/210988-21latency_hist07:11:372
249940,0watchdog/27067-21ntpq08:41:542
249940,0watchdog/221450-21kthreadcore06:51:552
249940,0watchdog/215123-21cut06:46:552
249940,0watchdog/20-21swapper/211:41:532
249940,0watchdog/20-21swapper/211:21:532
249940,0watchdog/20-21swapper/207:36:542
179940,0migration/19204-21taskset09:06:511
179940,0migration/19019-21irqrtprio09:26:501
179940,0migration/17462-21kthreadcore10:46:531
179940,0migration/16038-21latency_hist10:26:351
179940,0migration/14288-21kthreadcore08:41:511
179940,0migration/13768-21kthreadcore07:26:541
179940,0migration/13299-21kthreadcore09:21:521
179940,0migration/132250-21latency_hist09:01:351
179940,0migration/129605-21kthreadcore08:36:521
179940,0migration/128238-21kthreadcore08:11:531
179940,0migration/128166-21latency_hist11:41:351
179940,0migration/126365-21runrttasks11:16:541
179940,0migration/126204-21kthreadcore09:16:561
179940,0migration/125078-21idleruntime08:56:491
179940,0migration/119957-21kthreadcore09:51:531
179940,0migration/119161-21kthreadcore10:11:531
179940,0migration/117189-21kthreadcore10:51:521
179940,0migration/116515-21kthreadcore08:26:531
179940,0migration/115171-21kthreadcore11:11:521
179940,0migration/114307-21munin-node08:47:001
179940,0migration/113691-21fschecks_time08:01:511
179940,0migration/11320-21kthreadcore07:01:541
179940,0migration/11203-21kthreadcore10:41:531
179940,0migration/111849-21kthreadcore06:46:541
169940,0watchdog/15794-21chrt07:53:141
169940,0watchdog/1318-21kthreadcore11:21:531
169940,0watchdog/120904-21fschecks_time11:36:491
169940,0watchdog/118663-21ssh11:32:371
169940,0watchdog/115138-21interrupts10:31:501
169940,0watchdog/10-21swapper/109:41:501
169940,0watchdog/10-21swapper/107:16:541
149940,0migration/08507-21kthreadcore12:06:520
149940,0migration/06037-21gltestperf07:31:480
149940,0migration/0337-21kthreadcore11:21:530
149940,0migration/030487-21kthreadcore12:01:530
149940,0migration/024028-21kthreadcore10:16:540
149940,0migration/020454-21sh10:54:230
149940,0migration/019567-21latency_hist08:06:360
149940,0migration/018346-21kthreadcore09:51:520
149940,0migration/016288-21kthreadcore08:26:530
149940,0migration/015884-21aten_r1power_vo09:31:490
98419932,0cyclictest26236-21awk07:46:512
98409932,0cyclictest7720-21cut08:21:511
98409932,0cyclictest7230-21awk07:56:511
98409932,0cyclictest7230-21awk07:56:511
98409932,0cyclictest4764-21awk11:46:501
98409932,0cyclictest14807-21kthreadcore12:11:521
98409932,0cyclictest1396-21awk08:16:521
98399933,0cyclictest25254-21kworker/0:108:31:470
98399933,0cyclictest25254-21kworker/0:107:41:530
98399933,0cyclictest25254-21kworker/0:106:56:540
98399933,0cyclictest17063-21kworker/0:009:56:450
98399933,0cyclictest17063-21kworker/0:009:11:530
98399932,0cyclictest30764-21cpu10:21:480
98399930,0cyclictest24319-21munin-node07:21:510
98399930,0cyclictest11192-21telnet07:11:480
98399930,0cyclictest0-21swapper/007:47:280
339930,0migration/38789-21kthreadcore07:06:543
29715030,0irq/26-eth0-rx-0-21swapper/308:36:463
29715030,0irq/26-eth0-rx-0-21swapper/308:01:493
29715030,0irq/26-eth0-rx-0-21swapper/307:01:483
29715030,0irq/26-eth0-rx-0-21swapper/306:59:463
169930,0watchdog/16559-21runrttasks09:56:541
339920,0migration/31944-21diskstats08:41:473
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional