You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-02 - 15:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Thu Jul 02, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
508226665,0sleep00-21swapper/006:50:540
495825040,0sleep30-21swapper/306:49:253
496123829,0sleep10-21swapper/106:49:271
497323728,0sleep20-21swapper/206:49:362
51619966,0cyclictest5495-21kworker/0:011:19:240
51619966,0cyclictest5495-21kworker/0:009:13:220
51619966,0cyclictest11788-21kworker/0:111:53:360
51619966,0cyclictest11788-21kworker/0:111:43:440
51619966,0cyclictest11788-21kworker/0:111:39:420
51619965,0cyclictest5495-21kworker/0:011:23:360
51619965,0cyclictest5495-21kworker/0:009:55:100
51619965,0cyclictest11788-21kworker/0:111:47:560
4160,0ktimersoftd/00-21swapper/010:06:060
339960,0migration/332413-21munin-node07:11:113
339960,0migration/326625-21sh10:44:023
339960,0migration/326064-21sh10:22:033
339960,0migration/325875-21sh11:22:463
339960,0migration/320661-21sendmail_mailqu08:11:203
339960,0migration/317807-21sh11:58:413
339960,0migration/31297-21sh11:47:553
339960,0migration/310749-21sh09:53:543
339960,0migration/310660-21sh10:34:253
339960,0migration/310632-21sh09:12:483
339960,0migration/310065-21sh11:13:293
29725060,0irq/27-eth0-tx-19373-21munin-node11:01:122
29715060,0irq/26-eth0-rx-5899-21cut06:51:123
29715060,0irq/26-eth0-rx-22958-21kthreadcore07:26:163
19160,0ktimersoftd/10-21swapper/110:06:061
149960,0migration/09997-21sh10:52:560
149960,0migration/027136-21sh10:45:300
51639955,0cyclictest0-21swapper/209:58:032
51639950,0cyclictest0-21swapper/210:27:422
51639950,0cyclictest0-21swapper/209:48:262
51629955,0cyclictest3364-21diskmemload11:43:461
51629955,0cyclictest0-21swapper/110:51:161
51629955,0cyclictest0-21swapper/110:34:231
51629955,0cyclictest0-21swapper/109:38:061
51629955,0cyclictest0-21swapper/109:03:441
51629950,0cyclictest0-21swapper/112:00:471
51629950,0cyclictest0-21swapper/111:28:371
51629950,0cyclictest0-21swapper/110:57:151
51629950,0cyclictest0-21swapper/110:46:411
51629950,0cyclictest0-21swapper/109:46:181
51629950,0cyclictest0-21swapper/108:55:421
51619955,0cyclictest5495-21kworker/0:011:31:060
51619955,0cyclictest5495-21kworker/0:011:26:020
51619955,0cyclictest5495-21kworker/0:011:11:040
51619955,0cyclictest5495-21kworker/0:011:06:000
51619955,0cyclictest5495-21kworker/0:011:01:020
51619955,0cyclictest5495-21kworker/0:010:56:000
51619955,0cyclictest5495-21kworker/0:010:46:080
51619955,0cyclictest5495-21kworker/0:010:36:000
51619955,0cyclictest5495-21kworker/0:010:31:000
51619955,0cyclictest5495-21kworker/0:010:26:060
51619955,0cyclictest5495-21kworker/0:010:21:020
51619955,0cyclictest5495-21kworker/0:010:11:080
51619955,0cyclictest5495-21kworker/0:010:01:040
51619955,0cyclictest5495-21kworker/0:010:01:040
51619955,0cyclictest5495-21kworker/0:009:56:060
51619955,0cyclictest5495-21kworker/0:009:46:060
51619955,0cyclictest5495-21kworker/0:009:41:060
51619955,0cyclictest5495-21kworker/0:009:36:000
51619955,0cyclictest5495-21kworker/0:009:31:000
51619955,0cyclictest5495-21kworker/0:009:26:100
51619955,0cyclictest5495-21kworker/0:009:21:000
51619955,0cyclictest5495-21kworker/0:009:16:040
51619955,0cyclictest5495-21kworker/0:009:06:140
51619955,0cyclictest5495-21kworker/0:009:01:300
51619955,0cyclictest5495-21kworker/0:008:56:080
51619955,0cyclictest5495-21kworker/0:008:51:000
51619955,0cyclictest5495-21kworker/0:008:46:020
51619955,0cyclictest5495-21kworker/0:008:41:000
51619955,0cyclictest5495-21kworker/0:008:36:020
51619955,0cyclictest5495-21kworker/0:008:31:000
51619955,0cyclictest5495-21kworker/0:008:26:000
51619955,0cyclictest5495-21kworker/0:008:21:020
51619955,0cyclictest5495-21kworker/0:008:16:000
51619955,0cyclictest5495-21kworker/0:008:11:040
51619955,0cyclictest5495-21kworker/0:008:06:110
51619955,0cyclictest5495-21kworker/0:008:01:010
51619955,0cyclictest5495-21kworker/0:007:56:010
51619955,0cyclictest5495-21kworker/0:007:51:030
51619955,0cyclictest5495-21kworker/0:007:46:170
51619955,0cyclictest5495-21kworker/0:007:41:130
51619955,0cyclictest5495-21kworker/0:007:36:010
51619955,0cyclictest5495-21kworker/0:007:31:030
51619955,0cyclictest5495-21kworker/0:007:26:050
51619955,0cyclictest5495-21kworker/0:007:21:030
51619955,0cyclictest5495-21kworker/0:007:16:070
51619955,0cyclictest5495-21kworker/0:007:11:010
51619955,0cyclictest5495-21kworker/0:007:06:030
51619955,0cyclictest5495-21kworker/0:007:01:010
51619955,0cyclictest5495-21kworker/0:006:56:090
51619955,0cyclictest5495-21kworker/0:006:51:030
51619955,0cyclictest11788-21kworker/0:112:16:020
51619955,0cyclictest11788-21kworker/0:112:11:000
51619955,0cyclictest11788-21kworker/0:112:06:060
51619955,0cyclictest11788-21kworker/0:112:01:080
51619955,0cyclictest11788-21kworker/0:111:56:000
51619955,0cyclictest0-21swapper/010:16:000
35150,0ktimersoftd/30-21swapper/310:06:063
35150,0ktimersoftd/30-21swapper/310:00:043
339950,0migration/37446-21kthreadcore11:31:163
339950,0migration/37381-21aten_r1power_cu07:41:103
339950,0migration/34548-21if_eth008:51:143
339950,0migration/331967-21kthreadcore10:46:153
339950,0migration/327346-21munin-node08:16:233
339950,0migration/326634-21munin-node07:06:163
339950,0migration/320013-21munin-node09:41:083
339950,0migration/318903-21taskset09:18:163
339950,0migration/314825-21hwlatdetect07:46:123
339950,0migration/31067-21smart_sdb10:26:213
339950,0migration/31043-21missed_timers09:46:183
29725050,0irq/27-eth0-tx-4565-21perl09:31:112
29725050,0irq/27-eth0-tx-4426-21kthreadcore11:11:142
29725050,0irq/27-eth0-tx-3209-21munin-node10:51:222
29725050,0irq/27-eth0-tx-28165-21munin-node09:26:132
29725050,0irq/27-eth0-tx-27397-21df11:46:102
29725050,0irq/27-eth0-tx-27275-21munin-node11:26:162
29725050,0irq/27-eth0-tx-26914-21munin-node12:06:122
29725050,0irq/27-eth0-tx-25904-21ssh12:03:542
29725050,0irq/27-eth0-tx-19685-21munin-node10:21:152
29725050,0irq/27-eth0-tx-12962-21if_err_eth009:16:142
29725050,0irq/27-eth0-tx-11342-21munin-node10:56:102
29725050,0irq/27-eth0-tx-11262-21df_inode11:56:082
29725050,0irq/27-eth0-tx-0-21swapper/211:45:452
29725050,0irq/27-eth0-tx-0-21swapper/211:40:002
29715050,0irq/26-eth0-rx-9672-21python09:31:193
29715050,0irq/26-eth0-rx-8100-21ntpq08:26:183
29715050,0irq/26-eth0-rx-32585-21processes12:06:193
29715050,0irq/26-eth0-rx-29289-21cut11:06:143
29715050,0irq/26-eth0-rx-28570-21diskstats09:26:133
29715050,0irq/26-eth0-rx-27052-21sh11:05:423
29715050,0irq/26-eth0-rx-20009-21if_eth1.311:41:133
29715050,0irq/26-eth0-rx-1958-21ssh09:07:013
29715050,0irq/26-eth0-rx-18851-21ssh11:00:163
29715050,0irq/26-eth0-rx-18297-40yum-updatesd-he11:39:473
29715050,0irq/26-eth0-rx-13440-21diskstats07:21:123
29715050,0irq/26-eth0-rx-0-21swapper/312:18:113
29715050,0irq/26-eth0-rx-0-21swapper/312:11:573
29715050,0irq/26-eth0-rx-0-21swapper/312:01:073
29715050,0irq/26-eth0-rx-0-21swapper/311:16:183
29715050,0irq/26-eth0-rx-0-21swapper/310:51:113
29715050,0irq/26-eth0-rx-0-21swapper/310:01:093
29715050,0irq/26-eth0-rx-0-21swapper/310:01:093
29715050,0irq/26-eth0-rx-0-21swapper/309:24:563
29715050,0irq/26-eth0-rx-0-21swapper/308:56:223
27150,0ktimersoftd/20-21swapper/210:06:062
259950,0migration/29419-21aten_r1power_po08:31:112
259950,0migration/26323-21kthreadcore10:11:152
259950,0migration/222934-21kthreadcore11:21:142
259950,0migration/222250-21kthreadcore07:26:152
259950,0migration/217787-21sh10:36:532
259950,0migration/212116-21kthreadcore12:16:152
259950,0migration/211561-21sh09:15:122
259950,0migration/211173-21sh11:16:052
19150,0ktimersoftd/10-21swapper/110:00:041
179950,0migration/13602-21munin-node12:11:131
179950,0migration/127101-21sh10:45:241
179950,0migration/121774-21munin-node08:16:111
179950,0migration/121456-21kthreadcore12:01:151
179950,0migration/114797-21kthreadcore09:16:161
179950,0migration/113976-21rt-features08:06:211
179950,0migration/11118-21taskset12:07:431
169950,0watchdog/126608-21kthreadcore08:41:171
51639944,0cyclictest0-21swapper/210:41:252
51639943,0cyclictest8212-21awk07:41:142
51639943,0cyclictest4599-21awk09:51:122
51639943,0cyclictest3556-21lldpd08:56:112
51639943,0cyclictest3556-21lldpd08:38:412
51639943,0cyclictest3556-21lldpd07:31:412
51639943,0cyclictest3556-21lldpd07:05:092
51639943,0cyclictest28901-21awk09:06:152
51639943,0cyclictest28302-21awk07:56:142
51639943,0cyclictest1424-21awk07:36:132
51639940,0cyclictest19758-21munin-node10:01:112
51639940,0cyclictest19758-21munin-node10:01:112
51629944,0cyclictest0-21swapper/109:54:301
51629943,0cyclictest4742-21awk09:11:131
51629943,0cyclictest4500-21awk10:11:131
51629943,0cyclictest4097-21awk11:11:121
51629943,0cyclictest3556-21lldpd11:51:151
51629943,0cyclictest3556-21lldpd08:26:111
51629943,0cyclictest3556-21lldpd08:12:411
51629943,0cyclictest3556-21lldpd07:02:391
51629943,0cyclictest3556-21lldpd06:56:091
51629943,0cyclictest3556-21lldpd06:51:101
51629943,0cyclictest3514-21snmpd07:08:181
51629943,0cyclictest20640-21awk10:01:131
51629943,0cyclictest20640-21awk10:01:131
51629943,0cyclictest20240-21awk11:21:131
51629943,0cyclictest0-21swapper/111:38:141
339940,0migration/328923-21kthreadcore07:31:163
339940,0migration/327036-21taskset07:55:103
339940,0migration/323926-21kthreadcore07:01:163
339940,0migration/313585-21kthreadcore09:36:163
339940,0migration/311479-21kthreadcore08:06:173
29725040,0irq/27-eth0-tx-8682-21ssh12:11:212
29725040,0irq/27-eth0-tx-4742-21cut11:51:142
29725040,0irq/27-eth0-tx-0-21swapper/211:31:192
29725040,0irq/27-eth0-tx-0-21swapper/210:46:442
29725040,0irq/27-eth0-tx-0-21swapper/210:31:132
29725040,0irq/27-eth0-tx-0-21swapper/209:21:062
29725040,0irq/27-eth0-tx-0-21swapper/208:53:012
29715040,0irq/26-eth0-rx-23350-21tail08:41:133
29715040,0irq/26-eth0-rx-0-21swapper/311:51:443
29715040,0irq/26-eth0-rx-0-21swapper/311:26:043
29715040,0irq/26-eth0-rx-0-21swapper/310:36:113
29715040,0irq/26-eth0-rx-0-21swapper/310:16:073
29715040,0irq/26-eth0-rx-0-21swapper/310:11:103
29715040,0irq/26-eth0-rx-0-21swapper/309:01:153
29715040,0irq/26-eth0-rx-0-21swapper/307:16:093
29715040,0irq/26-eth0-rx-0-21swapper/306:56:103
259940,0migration/25364-21kthreadcore08:01:162
259940,0migration/23615-21irqcore08:26:142
259940,0migration/230808-21kthreadcore08:46:142
259940,0migration/224152-21kthreadcore08:16:172
259940,0migration/217418-21kthreadcore07:46:152
259940,0migration/217371-21kthreadcore07:21:172
259940,0migration/214458-21runrttasks08:07:262
259940,0migration/212104-21fschecks_count10:16:122
249940,0watchdog/221606-21kthreadcore09:41:132
249940,0watchdog/212535-21fschecks_time09:36:132
249940,0watchdog/20-21swapper/211:06:092
249940,0watchdog/20-21swapper/209:01:132
179940,0migration/14610-21kthreadcore07:11:161
179940,0migration/13145-21kthreadcore07:36:151
179940,0migration/126232-21latency_hist07:30:591
179940,0migration/124171-21kthreadcore10:21:161
179940,0migration/122429-21kthreadcore07:51:131
179940,0migration/12166-21fschecks_time08:01:121
179940,0migration/118359-21kthreadcore08:36:151
179940,0migration/117257-21diskmemload10:16:191
179940,0migration/111548-21kthreadcore08:31:161
179940,0migration/111043-21sh09:34:141
169940,0watchdog/19510-21ssh11:32:291
169940,0watchdog/128448-21iostat_ios11:06:131
169940,0watchdog/128165-21munin-node09:26:171
169940,0watchdog/127970-21ssh09:06:051
169940,0watchdog/126270-21sh09:41:571
169940,0watchdog/120261-21if_err_eth1.211:01:131
169940,0watchdog/111830-21ntp_offset07:16:181
169940,0watchdog/10-21swapper/110:36:171
169940,0watchdog/10-21swapper/108:56:251
8215030,0irq/24-0000:00:0-21swapper/206:56:032
51639932,0cyclictest7367-21awk07:16:142
51639932,0cyclictest389-21awk07:11:132
51639932,0cyclictest15164-21cpu08:11:112
51639930,0cyclictest25906-21fschecks_time07:06:132
51629933,0cyclictest3556-21lldpd07:47:111
51629933,0cyclictest3556-21lldpd07:41:411
51629932,0cyclictest30697-21kthreadcore08:46:141
51629932,0cyclictest29142-21awk08:21:141
51629932,0cyclictest28278-21awk07:56:141
51629932,0cyclictest11199-21munin-node11:16:171
51629930,0cyclictest31882-21port_sshpriv07:31:191
339930,0migration/329970-21kthreadcore08:21:163
29715030,0irq/26-eth0-rx-0-21swapper/308:46:103
29715030,0irq/26-eth0-rx-0-21swapper/308:36:103
29715030,0irq/26-eth0-rx-0-21swapper/308:04:463
29715030,0irq/26-eth0-rx-0-21swapper/307:56:103
29715030,0irq/26-eth0-rx-0-21swapper/307:37:393
259930,0migration/210713-21missed_timers06:51:172
249930,0watchdog/226609-21kthreadcore08:41:172
249930,0watchdog/222281-21kthreadcore07:51:132
249930,0watchdog/20-21swapper/208:21:212
169930,0watchdog/13364-21diskmemload12:16:001
169930,0watchdog/10-21swapper/111:46:401
169930,0watchdog/10-21swapper/110:26:051
169930,0watchdog/10-21swapper/109:21:171
169930,0watchdog/10-21swapper/107:21:181
29715020,0irq/26-eth0-rx-0-21swapper/308:31:103
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional