You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-14 - 14:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Fri Aug 14, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2061023727,0sleep30-21swapper/306:45:583
2058523627,0sleep10-21swapper/106:45:441
2050923423,0sleep00-21swapper/006:44:470
2035622824,0sleep20-21swapper/206:43:012
4160,0ktimersoftd/00-21swapper/011:10:510
339960,0migration/35136-21sh12:01:513
339960,0migration/329084-21fschecks_count07:17:053
339960,0migration/327480-21sh12:12:323
339960,0migration/326332-21aten_r1power_vo09:32:053
339960,0migration/323692-21irqcore11:32:073
339960,0migration/316816-21sh10:06:443
29725060,0irq/27-eth0-tx-23942-21irqstats11:32:082
29715060,0irq/26-eth0-rx-17278-21ssh10:07:033
207629965,0cyclictest1668-21grep07:42:112
207619960,0cyclictest0-21swapper/109:48:431
207609960,0cyclictest0-21swapper/010:08:280
149960,0migration/020340-21kthreadcore09:07:110
149960,0migration/016036-21sh10:46:570
149960,0migration/012891-21sh12:06:220
149960,0migration/010247-21irqcore10:02:080
339950,0migration/3835-21kthreadcore11:17:083
339950,0migration/36659-21kthreadcore09:37:093
339950,0migration/36213-21munin-node11:42:053
339950,0migration/35156-21kthreadcore06:57:113
339950,0migration/332222-21munin-node09:12:123
339950,0migration/332145-21kthreadcore11:37:083
339950,0migration/328965-21sh11:55:043
339950,0migration/327194-21kthreadcore08:27:103
339950,0migration/323901-21kthreadcore09:07:123
339950,0migration/322954-21kthreadcore09:27:103
339950,0migration/322700-21taskset10:48:483
339950,0migration/320912-21latency_hist06:46:543
339950,0migration/318504-21idleruntime09:47:083
339950,0migration/315802-21needreboot09:22:123
339950,0migration/315521-21cpuspeed_turbos07:07:083
339950,0migration/312023-21kthreadcore07:52:113
339950,0migration/310143-21kthreadcore10:42:083
29725050,0irq/27-eth0-tx-4793-21munin-node08:12:100
29725050,0irq/27-eth0-tx-32722-21munin-run10:16:522
29725050,0irq/27-eth0-tx-30523-21fschecks_time11:57:062
29725050,0irq/27-eth0-tx-17224-21munin-node07:57:180
29725050,0irq/27-eth0-tx-13940-21seq11:25:162
29725050,0irq/27-eth0-tx-12191-21kthreadcore09:42:112
29725050,0irq/27-eth0-tx-0-21swapper/212:02:092
29725050,0irq/27-eth0-tx-0-21swapper/210:02:152
29725050,0irq/27-eth0-tx-0-21swapper/209:18:432
29725050,0irq/27-eth0-tx-0-21swapper/209:02:362
29725050,0irq/27-eth0-tx-0-21swapper/008:27:120
29725050,0irq/27-eth0-tx-0-21swapper/008:22:060
29715050,0irq/26-eth0-rx-5824-21diskstats12:02:053
29715050,0irq/26-eth0-rx-31834-21df_abs08:32:093
29715050,0irq/26-eth0-rx-30606-21ntpdc10:12:123
29715050,0irq/26-eth0-rx-27192-21kthreadcore11:12:093
29715050,0irq/26-eth0-rx-26626-21ssh08:51:503
29715050,0irq/26-eth0-rx-17509-21if_eth110:27:073
29715050,0irq/26-eth0-rx-15649-21ssh10:24:563
29715050,0irq/26-eth0-rx-0-21swapper/312:10:533
29715050,0irq/26-eth0-rx-0-21swapper/311:07:083
29715050,0irq/26-eth0-rx-0-21swapper/311:05:063
29715050,0irq/26-eth0-rx-0-21swapper/311:01:313
29715050,0irq/26-eth0-rx-0-21swapper/310:56:073
29715050,0irq/26-eth0-rx-0-21swapper/310:32:053
29715050,0irq/26-eth0-rx-0-21swapper/309:58:263
29715050,0irq/26-eth0-rx-0-21swapper/309:52:043
29715050,0irq/26-eth0-rx-0-21swapper/309:17:163
29715050,0irq/26-eth0-rx-0-21swapper/309:01:513
29715050,0irq/26-eth0-rx-0-21swapper/307:25:323
27150,0ktimersoftd/20-21swapper/211:16:442
27150,0ktimersoftd/20-21swapper/211:10:512
259950,0migration/25602-21latency_hist08:36:532
259950,0migration/2379-21sh09:33:592
259950,0migration/226720-21latency_hist09:11:522
259950,0migration/226244-21kthreadcore11:52:122
259950,0migration/225977-21sh09:10:062
259950,0migration/225435-21taskset09:30:272
259950,0migration/222536-21kthreadcore08:22:102
259950,0migration/22213-21kthreadcore08:07:112
259950,0migration/22213-21kthreadcore08:07:112
259950,0migration/215074-21sh10:23:132
259950,0migration/211599-21missed_timers11:42:122
249950,0watchdog/27742-21timerwakeupswit09:37:152
249950,0watchdog/220659-21needreboot07:07:162
249950,0watchdog/219827-21sensors_volt11:47:142
207629955,0cyclictest0-21swapper/211:17:142
207629955,0cyclictest0-21swapper/210:50:262
207629950,0cyclictest0-21swapper/212:14:562
207629950,0cyclictest0-21swapper/210:32:372
207619955,0cyclictest0-21swapper/112:10:461
207619955,0cyclictest0-21swapper/112:05:521
207619955,0cyclictest0-21swapper/110:23:141
207619955,0cyclictest0-21swapper/109:34:031
207619954,0cyclictest3556-21lldpd10:27:221
207619954,0cyclictest3556-21lldpd09:06:211
207619950,0cyclictest0-21swapper/110:37:251
207619950,0cyclictest0-21swapper/108:53:511
207619950,0cyclictest0-21swapper/107:00:481
207609955,0cyclictest0-21swapper/012:14:450
207609955,0cyclictest0-21swapper/009:41:490
207609955,0cyclictest0-21swapper/006:47:080
207609950,0cyclictest0-21swapper/011:03:200
207609950,0cyclictest0-21swapper/010:45:030
19150,0ktimersoftd/10-21swapper/111:35:461
19150,0ktimersoftd/10-21swapper/111:17:571
19150,0ktimersoftd/10-21swapper/111:16:441
19150,0ktimersoftd/10-21swapper/111:10:511
179950,0migration/17888-21needreboot09:17:111
179950,0migration/14749-21latency_hist08:11:541
179950,0migration/128138-21kthreadcore10:12:101
179950,0migration/127195-21latency07:12:121
179950,0migration/115954-21pmu-power09:22:141
169950,0watchdog/19399-21tr11:42:111
169950,0watchdog/130130-21missed_timers08:27:111
169950,0watchdog/123220-21irqrtprio11:52:101
149950,0migration/09844-21kthreadcore11:22:110
149950,0migration/07415-21munin-node06:57:130
149950,0migration/06394-21cpuspeed_turbos11:42:060
149950,0migration/05691-21kthreadcore08:57:100
149950,0migration/029090-21kthreadcore09:12:100
149950,0migration/027757-21munin-node06:52:050
149950,0migration/027588-21kthreadcore11:32:090
149950,0migration/025858-21taskset08:49:430
149950,0migration/025804-21kthreadcore07:37:100
149950,0migration/021557-21sh11:29:210
149950,0migration/02056-21kthreadcore10:57:080
149950,0migration/01934-21gltestperf09:57:070
149950,0migration/019258-21kthreadcore07:07:140
149950,0migration/017502-21sh09:25:260
149950,0migration/015624-21kthreadcore11:47:090
149950,0migration/014110-21gltestperf12:07:050
149950,0migration/014010-21munin-node07:02:160
149950,0migration/012818-21kthreadcore10:22:100
149950,0migration/011164-21kthreadcore07:27:090
149950,0migration/010924-21aten_r1power_vo09:02:070
339940,0migration/35577-21kthreadcore07:47:103
339940,0migration/330895-21kthreadcore06:52:113
339940,0migration/32793-21kthreadcore08:07:113
339940,0migration/32793-21kthreadcore08:07:113
339940,0migration/326000-21kthreadcore07:37:113
339940,0migration/31508-21if_eth010:17:083
339940,0migration/312213-21kthreadcore07:27:093
339940,0migration/311861-21kthreadcore11:22:113
339940,0migration/310884-21taskset08:13:003
29725040,0irq/27-eth0-tx-0-21swapper/210:57:202
29725040,0irq/27-eth0-tx-0-21swapper/210:42:022
29725040,0irq/27-eth0-tx-0-21swapper/210:37:242
29725040,0irq/27-eth0-tx-0-21swapper/210:29:312
29725040,0irq/27-eth0-tx-0-21swapper/210:07:532
29725040,0irq/27-eth0-tx-0-21swapper/209:57:122
29725040,0irq/27-eth0-tx-0-21swapper/209:52:342
29725040,0irq/27-eth0-tx-0-21swapper/209:22:022
29725040,0irq/27-eth0-tx-0-21swapper/208:58:402
29725040,0irq/27-eth0-tx-0-21swapper/208:49:092
29725040,0irq/27-eth0-tx-0-21swapper/007:52:150
29725040,0irq/27-eth0-tx-0-21swapper/007:22:200
29715040,0irq/26-eth0-rx-17032-21kthreadcore08:42:103
29715040,0irq/26-eth0-rx-13852-21grep08:17:113
29715040,0irq/26-eth0-rx-0-21swapper/311:47:093
29715040,0irq/26-eth0-rx-0-21swapper/311:27:123
29715040,0irq/26-eth0-rx-0-21swapper/310:37:123
29715040,0irq/26-eth0-rx-0-21swapper/309:42:143
29715040,0irq/26-eth0-rx-0-21swapper/309:03:343
29715040,0irq/26-eth0-rx-0-21swapper/308:52:143
259940,0migration/26997-21kthreadcore07:22:112
259940,0migration/24755-21munin-node07:47:082
259940,0migration/228902-21kthreadcore08:52:092
259940,0migration/225260-21kthreadcore06:47:112
259940,0migration/222980-21aten_r1power_en07:37:042
259940,0migration/212361-21if_eth008:17:092
249940,0watchdog/229938-21timerwakeupswit10:52:152
249940,0watchdog/220628-21ssh11:27:152
249940,0watchdog/219879-21kthreadcore07:32:122
249940,0watchdog/213367-21munin-node11:02:152
249940,0watchdog/211457-21sensors_temp08:37:152
249940,0watchdog/20-21swapper/208:27:112
207629943,0cyclictest5748-21awk08:12:102
207629943,0cyclictest31471-21awk11:37:062
207629943,0cyclictest24706-21awk08:02:072
207629943,0cyclictest18539-21awk09:47:082
207629943,0cyclictest1483-21awk10:17:082
207629943,0cyclictest14227-21awk12:07:062
207619944,0cyclictest0-21swapper/111:31:211
207619943,0cyclictest3556-21lldpd10:56:531
207619943,0cyclictest3556-21lldpd08:10:501
207619943,0cyclictest3556-21lldpd08:10:501
207619943,0cyclictest3556-21lldpd07:39:201
207619943,0cyclictest3514-21snmpd10:49:461
207619943,0cyclictest3514-21snmpd08:33:451
207619943,0cyclictest3514-21snmpd07:07:461
207619943,0cyclictest30684-21awk11:57:071
207619943,0cyclictest22192-21awk12:12:071
207619943,0cyclictest21903-21awk06:47:081
207619943,0cyclictest19239-21awk09:27:081
207609944,0cyclictest0-21swapper/011:14:220
207609944,0cyclictest0-21swapper/009:30:280
207609943,0cyclictest4817-21awk07:47:090
207609943,0cyclictest3556-21lldpd10:36:230
207609943,0cyclictest3514-21snmpd10:17:000
207609943,0cyclictest3514-21snmpd09:48:460
207609943,0cyclictest30716-21awk11:57:080
207609943,0cyclictest24957-21awk10:52:070
207609943,0cyclictest17112-21awk07:32:090
207609943,0cyclictest12330-21awk08:17:080
207609943,0cyclictest0-21swapper/010:12:060
207609940,0cyclictest0-21swapper/011:37:250
179940,0migration/19673-21irqcore07:02:131
179940,0migration/17938-40yum-updatesd09:37:231
179940,0migration/16191-21kthreadcore07:22:111
179940,0migration/15672-21latency_hist08:36:541
179940,0migration/15405-21taskset11:40:281
179940,0migration/129311-21kthreadcore10:32:111
179940,0migration/128208-21fschecks_time06:52:071
179940,0migration/120674-21kthreadcore08:47:101
179940,0migration/116958-21taskset09:45:371
179940,0migration/11182-21kthreadcore07:17:101
179940,0migration/110117-21taskset07:49:251
169940,0watchdog/18505-21python08:57:151
169940,0watchdog/18113-21munin-node10:42:031
169940,0watchdog/129937-21timerwakeupswit10:52:151
169940,0watchdog/119612-21smartctl09:07:071
169940,0watchdog/114557-21kthreadcore08:17:111
169940,0watchdog/113878-21ssh11:03:111
169940,0watchdog/10-21swapper/111:47:101
169940,0watchdog/10-21swapper/110:07:031
169940,0watchdog/10-21swapper/109:12:111
169940,0watchdog/10-21swapper/107:52:111
149940,0migration/032426-21sh09:54:170
149940,0migration/025261-21kthreadcore11:52:120
339930,0migration/329975-21diskstats07:42:073
29725030,0irq/27-eth0-tx-0-21swapper/008:32:080
29715030,0irq/26-eth0-rx-0-21swapper/308:37:243
29715030,0irq/26-eth0-rx-0-21swapper/308:22:063
29715030,0irq/26-eth0-rx-0-21swapper/307:57:053
29715030,0irq/26-eth0-rx-0-21swapper/307:32:053
29715030,0irq/26-eth0-rx-0-21swapper/307:12:053
29715030,0irq/26-eth0-rx-0-21swapper/307:02:173
249930,0watchdog/20-21swapper/208:42:152
249930,0watchdog/20-21swapper/207:52:112
249930,0watchdog/20-21swapper/207:12:122
207629932,0cyclictest9483-21awk07:02:112
207629932,0cyclictest877-21sensors06:52:162
207629932,0cyclictest2884-21awk06:57:092
207629932,0cyclictest0-21swapper/207:26:542
207629930,0cyclictest28659-21aten2.4-expect07:17:032
207619932,0cyclictest6296-21grep09:57:111
207619932,0cyclictest3241-21irqbalance07:27:121
207619932,0cyclictest26575-21awk09:52:081
207619932,0cyclictest24786-21awk08:02:081
207619932,0cyclictest19110-21awk08:22:081
207609933,0cyclictest6052-21kworker/0:011:17:040
207609933,0cyclictest6052-21kworker/0:010:27:260
207609933,0cyclictest6052-21kworker/0:009:42:040
207609933,0cyclictest6052-21kworker/0:009:32:000
207609933,0cyclictest6052-21kworker/0:009:17:300
207609933,0cyclictest6052-21kworker/0:008:42:000
207609933,0cyclictest6052-21kworker/0:008:07:010
207609933,0cyclictest6052-21kworker/0:008:07:010
207609933,0cyclictest6052-21kworker/0:007:16:590
207609932,0cyclictest6720-21awk08:37:090
207609930,0cyclictest6327-40yum-updatesd-he10:37:230
207609930,0cyclictest27527-21tune2fs08:52:050
207609930,0cyclictest24428-21perl08:02:060
207609930,0cyclictest22608-21perl07:12:080
207609930,0cyclictest0-21swapper/007:42:080
179930,0migration/122299-21kthreadcore07:57:111
169930,0watchdog/132664-21kthreadcore07:42:111
169930,0watchdog/118870-21diskmemload11:21:551
169930,0watchdog/118870-21diskmemload10:02:351
169930,0watchdog/10-21swapper/110:21:271
169930,0watchdog/10-21swapper/107:32:121
29715020,0irq/26-eth0-rx-0-21swapper/308:01:593
207629920,0cyclictest0-21swapper/207:56:542
169920,0watchdog/10-21swapper/108:42:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional