You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-06 - 23:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Thu Aug 06, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31263211895,18sleep00-21swapper/007:06:340
31307210988,15sleep10-21swapper/107:07:081
31376210684,16sleep30-21swapper/307:08:023
1637121060,1sleep316370-21ssh11:22:083
30768210385,13sleep20-21swapper/207:05:282
158332910,4sleep011-21rcuc/009:10:020
287432730,0sleep10-21swapper/109:22:371
147952700,0sleep20-21swapper/211:54:302
185522540,5sleep03155999cyclictest07:55:170
3156299370,19cyclictest0-21swapper/309:50:103
3156299350,18cyclictest0-21swapper/310:05:133
31561993414,18cyclictest0-21swapper/211:55:122
18292320,1sleep10-21swapper/111:40:261
281422250,0sleep10-21swapper/111:35:001
31562992217,3cyclictest0-21swapper/311:50:113
3156199220,20cyclictest20353-21ssh12:00:122
3155999221,3cyclictest18563-21ssh11:25:100
31182220,2sleep337-21rcuc/311:09:293
3155999214,15cyclictest0-21swapper/011:05:110
31559992118,2cyclictest29807-21kworker/u8:112:20:040
31559992116,3cyclictest19741-21ssh10:20:100
31562992010,8cyclictest23371-21ssh09:16:533
3156199200,2cyclictest0-21swapper/211:25:102
31562991910,7cyclictest0-21swapper/312:20:143
31562991910,7cyclictest0-21swapper/310:38:233
3156299190,17cyclictest0-21swapper/311:02:593
3156299190,12cyclictest0-21swapper/309:13:143
3156099190,2cyclictest0-21swapper/109:50:091
3156299188,2cyclictest0-21swapper/310:40:163
3156299181,15cyclictest3728-21runrttasks11:48:363
3156299181,14cyclictest0-21swapper/307:46:513
3156299180,2cyclictest0-21swapper/312:34:133
3156299180,2cyclictest0-21swapper/309:47:353
3156299180,2cyclictest0-21swapper/309:33:533
3156299180,17cyclictest0-21swapper/312:25:163
3156299180,16cyclictest0-21swapper/309:23:393
3156299180,11cyclictest0-21swapper/311:15:023
3155999189,4cyclictest0-21swapper/011:17:050
3156299177,2cyclictest0-21swapper/310:56:033
3156299176,3cyclictest0-21swapper/311:40:163
3156299175,4cyclictest17161-21sh10:50:133
3156299175,3cyclictest8251-21grep08:50:143
3156299170,1cyclictest0-21swapper/311:25:243
3156299170,16cyclictest0-21swapper/311:12:023
3156299170,11cyclictest0-21swapper/312:01:463
3156299170,10cyclictest0-21swapper/310:14:003
31560991714,2cyclictest31478-21kworker/u8:010:52:051
31560991714,2cyclictest22842-21kworker/u8:009:17:051
3156299164,3cyclictest5669-21aten2.4_r3power07:25:133
3156299164,3cyclictest31333-21interrupts09:25:153
3156299164,3cyclictest15686-21cat10:15:163
3156299163,3cyclictest16341-21grep07:50:143
3156299163,3cyclictest0-21swapper/309:35:173
3156299161,4cyclictest17588-21turbostat.cron09:45:013
3156299161,13cyclictest2587-21pzem_energy08:35:303
3156299161,13cyclictest25072-21grep12:05:133
3156299161,13cyclictest0-21swapper/311:40:003
3156299160,9cyclictest0-21swapper/310:01:473
3156299160,8cyclictest0-21swapper/312:16:063
3156299160,15cyclictest0-21swapper/312:11:053
3156299160,15cyclictest0-21swapper/311:32:153
3156299160,15cyclictest0-21swapper/310:49:333
3156299160,15cyclictest0-21swapper/310:26:333
3156299160,11cyclictest0-21swapper/310:22:133
3156199160,14cyclictest10010-21diskstats07:35:102
31560991613,2cyclictest17355-21kworker/u8:010:09:051
31559991613,2cyclictest28315-21kworker/u8:211:36:050
31559991613,2cyclictest22612-21kworker/u8:212:04:020
3155999161,13cyclictest17846-21ssh10:17:360
3155999161,13cyclictest13603-21latency_hist09:05:000
3155999161,13cyclictest0-21swapper/009:45:490
88982150,2sleep00-21swapper/011:47:540
3156299157,2cyclictest0-21swapper/310:31:073
3156299156,2cyclictest15611-21diskmemload09:55:263
3156299154,3cyclictest8514-21wc07:30:173
3156299154,3cyclictest3728-21runrttasks09:07:193
3156299154,3cyclictest3728-21runrttasks07:35:363
3156299154,3cyclictest31832-21aten2.4_r3power07:10:113
3156299154,2cyclictest0-21swapper/309:01:013
3156299153,3cyclictest3728-21runrttasks08:08:123
3156299153,3cyclictest31447-21chrt08:26:093
3156299153,3cyclictest23984-21aten2.4_r3power08:10:113
3156299153,3cyclictest20751-21cut08:00:173
3156299153,3cyclictest15971-21uniq11:55:173
3156299153,2cyclictest0-21swapper/308:45:123
3156299151,4cyclictest22321-21sh12:35:143
31562991511,2cyclictest259272chrt08:15:123
31562991511,2cyclictest0-21swapper/307:40:113
31561991510,3cyclictest20684-21wc08:00:172
31561991510,3cyclictest0-21swapper/211:15:002
3156199150,13cyclictest0-21swapper/210:38:212
31560991512,2cyclictest31420-21kworker/u8:111:06:041
31560991512,2cyclictest17003-21kworker/u8:212:31:051
3156099151,13cyclictest0-21swapper/110:02:501
3156099151,12cyclictest25234-21hddtemp_smartct10:25:151
3156099150,13cyclictest0-21swapper/112:40:011
3155999151,3cyclictest32072-21pzem_voltage09:25:590
31559991512,2cyclictest28043-21kworker/u8:109:39:050
31559991512,2cyclictest16109-21kworker/u8:209:21:050
3155999151,12cyclictest0-21swapper/010:31:110
3155999151,12cyclictest0-21swapper/008:36:040
31559991510,3cyclictest0-21swapper/010:40:110
3155999150,2cyclictest15611-21diskmemload11:31:040
3156299144,3cyclictest0-21swapper/308:20:133
3156299143,3cyclictest5396-21sendmail-mta08:43:173
3156299143,3cyclictest32374-21sed08:30:123
3156299143,3cyclictest18556-21irqstats07:55:183
31561991411,2cyclictest0-21swapper/209:50:202
3156199140,3cyclictest4055-21sendmail-mta11:43:312
3156199140,13cyclictest0-21swapper/209:13:402
3156199140,13cyclictest0-21swapper/208:30:112
3156199140,12cyclictest0-21swapper/212:31:382
3156099147,3cyclictest221ktimersoftd/112:16:051
3156099144,2cyclictest23-21ksoftirqd/109:48:051
3156099141,3cyclictest26944-21cut08:15:291
31560991411,2cyclictest9950-21kworker/u8:110:21:051
31560991411,2cyclictest31478-21kworker/u8:010:42:011
31560991411,2cyclictest31478-21kworker/u8:010:32:051
31560991411,2cyclictest27635-21kworker/u8:108:21:051
31560991411,2cyclictest24586-21kworker/u8:011:04:061
31560991411,2cyclictest17387-21kworker/u8:007:54:051
31560991411,2cyclictest15335-21kworker/u8:207:21:051
31560991411,2cyclictest13809-21kworker/u8:211:21:051
31560991410,2cyclictest16292-21ssh10:49:501
3156099140,2cyclictest0-21swapper/109:35:051
3156099140,2cyclictest0-21swapper/109:25:491
3156099140,2cyclictest0-21swapper/107:25:191
3155999149,3cyclictest20825-21ssh09:15:080
3155999149,3cyclictest11883-21ssh10:45:110
3155999142,7cyclictest0-21swapper/012:20:010
31559991411,2cyclictest7667-21kworker/u8:107:47:040
31559991411,2cyclictest5360-21kworker/u8:210:39:050
31559991411,2cyclictest29807-21kworker/u8:112:27:050
31559991411,2cyclictest24586-21kworker/u8:011:12:050
31559991411,2cyclictest24586-21kworker/u8:011:02:060
31559991411,2cyclictest15557-21kworker/u8:012:09:050
3155999141,11cyclictest0-21swapper/008:06:010
3155999140,2cyclictest15611-21diskmemload09:54:040
3155999140,12cyclictest15611-21diskmemload10:25:170
3155999140,12cyclictest0-21swapper/009:43:510
35462130,1sleep00-21swapper/010:03:170
3156299130,6cyclictest0-21swapper/307:21:013
3156299130,2cyclictest0-21swapper/307:16:003
31561991310,2cyclictest22834-21ssh12:35:212
31561991310,2cyclictest16364-21ssh11:22:072
31561991310,2cyclictest0-21swapper/210:23:192
31561991310,2cyclictest0-21swapper/209:37:182
31561991310,2cyclictest0-21swapper/209:27:102
3156199130,2cyclictest0-21swapper/210:25:502
3156199130,2cyclictest0-21swapper/207:50:142
3156199130,12cyclictest0-21swapper/211:39:592
3156199130,12cyclictest0-21swapper/210:50:142
3156199130,12cyclictest0-21swapper/210:13:512
3156199130,12cyclictest0-21swapper/208:05:182
3156099139,2cyclictest18898-21cut07:55:311
3156099137,2cyclictest207150irq/24-eth110:19:531
3156099131,10cyclictest0-21swapper/108:01:001
31560991310,2cyclictest9821-21kworker/u8:109:07:051
31560991310,2cyclictest29807-21kworker/u8:112:22:041
31560991310,2cyclictest25014-21kworker/u8:008:56:051
31560991310,2cyclictest1389-21kworker/u8:007:19:041
31560991310,2cyclictest10283-21kworker/u8:211:51:051
31560991310,2cyclictest0-21swapper/111:10:151
31560991310,2cyclictest0-21swapper/109:57:201
3156099130,2cyclictest0-21swapper/112:25:291
3156099130,2cyclictest0-21swapper/111:55:041
3156099130,2cyclictest0-21swapper/111:15:051
3156099130,2cyclictest0-21swapper/110:35:391
3156099130,12cyclictest12494-21ssh10:11:501
3156099130,12cyclictest0-21swapper/111:35:111
3156099130,12cyclictest0-21swapper/111:27:501
3156099130,11cyclictest0-21swapper/112:07:501
3156099130,11cyclictest0-21swapper/111:45:281
3155999133,6cyclictest0-21swapper/008:25:590
3155999131,6cyclictest0-21swapper/008:45:010
3155999131,10cyclictest13427-21ssh11:52:240
3155999131,10cyclictest0-21swapper/012:10:430
31559991310,2cyclictest15335-21kworker/u8:207:24:040
31559991310,2cyclictest0-21swapper/012:31:020
31559991310,2cyclictest0-21swapper/011:55:350
31559991310,2cyclictest0-21swapper/011:41:000
31559991310,2cyclictest0-21swapper/011:20:110
31559991310,2cyclictest0-21swapper/010:12:570
3155999130,2cyclictest0-21swapper/010:08:290
3156199129,2cyclictest29253-21ssh09:23:242
3156199129,2cyclictest26467-21ssh11:00:112
3156199129,2cyclictest0-21swapper/212:23:202
3156199129,2cyclictest0-21swapper/212:05:202
3156199129,2cyclictest0-21swapper/211:33:352
3156199129,2cyclictest0-21swapper/211:15:182
3156199129,2cyclictest0-21swapper/210:31:222
3156199129,2cyclictest0-21swapper/207:45:132
3156199120,3cyclictest5307-21ssh09:31:112
3156199120,2cyclictest0-21swapper/212:19:482
3156199120,2cyclictest0-21swapper/212:12:472
3156199120,2cyclictest0-21swapper/209:41:372
3156199120,2cyclictest0-21swapper/209:16:022
3156199120,2cyclictest0-21swapper/208:26:002
3156199120,11cyclictest0-21swapper/212:27:342
3156199120,11cyclictest0-21swapper/211:45:482
3156199120,11cyclictest0-21swapper/210:40:392
3156199120,11cyclictest0-21swapper/210:06:322
3156199120,11cyclictest0-21swapper/207:56:052
3156199120,10cyclictest2232-21rm10:01:192
3156099129,2cyclictest7667-21kworker/u8:107:38:001
3156099129,2cyclictest31381-21kworker/u8:107:11:031
3156099129,2cyclictest25014-21kworker/u8:008:34:051
3156099129,2cyclictest0-21swapper/109:11:101
3156099129,2cyclictest0-21swapper/108:40:291
3156099129,2cyclictest0-21swapper/107:30:381
3156099122,7cyclictest0-21swapper/108:14:591
3156099121,9cyclictest0-21swapper/112:11:011
3156099121,6cyclictest0-21swapper/108:39:591
3156099120,7cyclictest0-21swapper/112:02:061
3156099120,2cyclictest0-21swapper/107:40:181
3156099120,11cyclictest0-21swapper/109:43:301
3156099120,10cyclictest207150irq/24-eth108:46:051
3155999129,2cyclictest0-21swapper/012:36:490
3155999129,2cyclictest0-21swapper/010:53:220
3155999129,2cyclictest0-21swapper/009:55:560
3155999121,8cyclictest4562-21gdm-simple-gree07:35:590
3155999120,7cyclictest0-21swapper/007:13:020
3155999120,2cyclictest0-21swapper/008:55:140
3155999120,11cyclictest0-21swapper/010:55:090
3155999120,11cyclictest0-21swapper/009:30:060
3155999120,11cyclictest0-21swapper/009:05:190
185152120,2sleep20-21swapper/209:45:162
3156199118,2cyclictest0-21swapper/211:05:052
3156199118,2cyclictest0-21swapper/209:03:482
3156199118,2cyclictest0-21swapper/208:51:012
3156199112,6cyclictest25105-21ssh10:58:272
3156199110,2cyclictest0-21swapper/209:55:212
3156199110,10cyclictest0-21swapper/210:45:572
3156199110,10cyclictest0-21swapper/210:15:372
3156099118,2cyclictest17387-21kworker/u8:008:05:051
3156099118,2cyclictest0-21swapper/110:55:301
3156099111,3cyclictest3424-21grep09:30:131
3156099111,2cyclictest7774-21munin-node1
3156099110,9cyclictest0-21swapper/107:46:491
3155999118,2cyclictest0-21swapper/008:00:160
3155999111,7cyclictest9414-21latency_hist07:35:000
3155999111,7cyclictest0-21swapper/007:15:020
3155999110,5cyclictest0-21swapper/008:20:000
3155999110,2cyclictest0-21swapper/008:52:480
3156199107,2cyclictest0-21swapper/208:35:162
3156199102,6cyclictest0-21swapper/208:16:012
3156199102,5cyclictest0-21swapper/209:10:012
3156199102,4cyclictest13479-21copy07:45:002
3156199100,2cyclictest0-21swapper/207:33:062
3156099101,7cyclictest0-21swapper/109:03:011
3156099100,8cyclictest0-21swapper/108:25:101
3155999107,2cyclictest17387-21kworker/u8:007:52:010
3155999107,2cyclictest0-21swapper/007:43:160
3155999107,2cyclictest0-21swapper/007:26:010
3155999100,2cyclictest0-21swapper/008:30:070
315629994,3cyclictest10440-21interrupts08:55:153
315619994,3cyclictest24069-21aten2.4-expect08:10:122
315619994,3cyclictest1555-21cpuspeed_turbos07:15:122
315619994,3cyclictest11574-21cron09:00:002
315619992,6cyclictest0-21swapper/208:47:592
315619991,3cyclictest5396-21sendmail-mta08:43:082
315619991,3cyclictest0-21swapper/207:10:122
315619990,8cyclictest0-21swapper/207:23:142
315599994,3cyclictest5841-21aten2.4_r3power08:45:120
315599992,6cyclictest0-21swapper/008:23:020
315599990,2cyclictest0-21swapper/008:11:260
315619985,2cyclictest5568-21aten2.4-expect07:25:132
315619983,3cyclictest27954-21dpkg08:20:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional