You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-29 - 18:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sun Mar 29, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12447211894,18sleep10-21swapper/107:07:011
12587211696,15sleep20-21swapper/207:08:492
12062211295,11sleep30-21swapper/307:06:023
1197429988,6sleep00-21swapper/007:06:000
37932810,0sleep10-21swapper/110:59:221
118172770,0sleep00-21swapper/011:06:500
181762750,1sleep10-21swapper/108:41:021
274042740,0sleep00-21swapper/011:23:540
100772740,0sleep30-21swapper/311:05:173
4982720,0sleep00-21swapper/009:14:070
183602720,0sleep00-21swapper/010:05:580
281212700,0sleep00-21swapper/011:58:240
243662690,1sleep337-21rcuc/308:56:033
1270999500,18cyclictest0-21swapper/208:15:112
12708994216,24cyclictest0-21swapper/111:20:121
1270799380,19cyclictest0-21swapper/011:15:100
272052230,0sleep10-21swapper/111:56:571
71812220,1sleep30-21swapper/311:02:003
1271099210,19cyclictest0-21swapper/312:15:113
1270999210,16cyclictest0-21swapper/211:31:042
202892200,0sleep30-21swapper/312:24:263
12709992017,2cyclictest6928-21kworker/u8:109:31:052
12709992017,2cyclictest6928-21kworker/u8:109:31:042
1270899200,2cyclictest0-21swapper/110:45:121
49572190,1sleep20-21swapper/209:51:452
12709991916,2cyclictest6928-21kworker/u8:109:45:042
12709991916,2cyclictest32691-21kworker/u8:209:25:042
1270999190,14cyclictest0-21swapper/212:18:012
1270899190,2cyclictest28733-21diskmemload09:10:131
1270799190,2cyclictest0-21swapper/010:35:150
1271099180,2cyclictest0-21swapper/309:55:103
12709991815,2cyclictest8366-21kworker/u8:008:21:042
12709991815,2cyclictest8281-21kworker/u8:011:04:012
12709991815,2cyclictest766-21kworker/u8:208:04:042
12709991815,2cyclictest3916-21kworker/u8:210:20:042
12709991815,2cyclictest32669-21kworker/u8:012:39:052
12709991815,2cyclictest32669-21kworker/u8:012:39:042
12709991815,2cyclictest27038-21kworker/u8:109:10:062
12709991815,2cyclictest23662-21kworker/u8:110:14:062
12709991815,2cyclictest19989-21kworker/u8:211:52:052
12709991815,2cyclictest15605-21kworker/u8:010:40:062
12709991815,2cyclictest1248-21kworker/u8:012:20:042
1270899180,16cyclictest0-21swapper/110:00:101
298072170,0sleep00-21swapper/010:18:240
12709991714,2cyclictest8281-21kworker/u8:011:08:052
12709991714,2cyclictest805-21kworker/u8:111:48:062
12709991714,2cyclictest805-21kworker/u8:111:40:042
12709991714,2cyclictest766-21kworker/u8:208:08:022
12709991714,2cyclictest3120-21kworker/u8:211:25:042
12709991714,2cyclictest27665-21kworker/u8:212:32:012
12709991714,2cyclictest25590-21kworker/u8:209:43:052
12709991714,2cyclictest18789-21kworker/u8:011:21:052
12709991714,2cyclictest18789-21kworker/u8:011:18:052
12709991714,2cyclictest14955-21kworker/u8:208:56:062
1271099161,3cyclictest0-21swapper/309:05:193
1271099160,14cyclictest0-21swapper/312:05:393
12709991613,2cyclictest805-21kworker/u8:111:37:052
12709991613,2cyclictest26598-21kworker/u8:107:51:052
12709991613,2cyclictest21130-21kworker/u8:007:41:052
12709991613,2cyclictest20376-21kworker/u8:008:47:042
12709991613,2cyclictest18599-21kworker/u8:207:38:042
12709991611,3cyclictest17820-21munin-node2
1270999160,11cyclictest0-21swapper/210:35:042
1270899161,6cyclictest207150irq/24-eth111:20:001
1271099151,3cyclictest0-21swapper/310:19:453
12710991512,2cyclictest0-21swapper/310:55:183
1271099150,13cyclictest3649-21snmpd09:44:083
12709991512,2cyclictest4139-21kworker/u8:108:13:042
12709991512,2cyclictest3916-21kworker/u8:210:06:052
12709991512,2cyclictest30012-21kworker/u8:010:56:062
12709991512,2cyclictest30012-21kworker/u8:010:53:042
12709991512,2cyclictest20376-21kworker/u8:009:18:042
12709991512,2cyclictest18599-21kworker/u8:207:27:052
12709991512,2cyclictest14955-21kworker/u8:209:00:042
12709991512,2cyclictest14955-21kworker/u8:208:37:042
1270999151,12cyclictest29456-21apt-get12:00:102
1270999150,2cyclictest0-21swapper/212:05:042
1270999150,2cyclictest0-21swapper/210:02:042
1270999150,13cyclictest20948-21cpuspeed_turbos09:35:142
12708991511,2cyclictest26006-21perl09:40:151
1270899151,12cyclictest11134-21munin-run12:15:011
12708991511,2cyclictest0-21swapper/110:51:461
1270899150,13cyclictest26215-21timerandwakeup09:01:011
12707991511,2cyclictest0-21swapper/008:56:030
1270799150,3cyclictest0-21swapper/007:11:010
1271099149,3cyclictest25761-21munin-node3
12710991411,2cyclictest0-21swapper/311:15:073
12710991411,2cyclictest0-21swapper/308:00:173
12710991410,2cyclictest0-21swapper/311:20:133
1271099140,2cyclictest28733-21diskmemload10:29:373
1271099140,2cyclictest0-21swapper/311:33:283
1271099140,12cyclictest31755-21ssh12:01:343
1271099140,12cyclictest25893-21fschecks_count12:30:143
1271099140,12cyclictest24251-21ssh10:12:073
1271099140,12cyclictest0-21swapper/309:25:183
1270999140,2cyclictest0-21swapper/212:29:042
1270999140,2cyclictest0-21swapper/211:10:012
1270999140,12cyclictest0-21swapper/209:55:052
1270899149,3cyclictest0-21swapper/111:35:191
1270899149,3cyclictest0-21swapper/108:00:001
12708991411,2cyclictest0-21swapper/112:04:581
12708991411,2cyclictest0-21swapper/111:51:271
12708991411,2cyclictest0-21swapper/110:37:561
12708991411,2cyclictest0-21swapper/109:32:471
12708991411,2cyclictest0-21swapper/109:32:461
12708991411,2cyclictest0-21swapper/109:26:561
12708991411,2cyclictest0-21swapper/107:20:161
1270899140,2cyclictest0-21swapper/112:38:481
1270899140,2cyclictest0-21swapper/112:38:471
1270899140,2cyclictest0-21swapper/108:05:201
1270899140,13cyclictest0-21swapper/111:41:071
1270899140,12cyclictest0-21swapper/110:25:171
1270899140,12cyclictest0-21swapper/109:20:121
1270899140,12cyclictest0-21swapper/107:15:291
1270799149,3cyclictest2046-21updatedb.mlocat08:01:320
1270799149,3cyclictest11226-21ls12:15:000
1270799142,7cyclictest18639-21gpgv11:15:010
1270799141,7cyclictest22380-21ssh10:44:590
1270799140,3cyclictest0-21swapper/007:45:010
1270799140,12cyclictest28733-21diskmemload09:50:110
1270799140,12cyclictest0-21swapper/009:40:130
251622130,1sleep028733-21diskmemload10:13:360
1271099138,3cyclictest19482-21awk10:41:023
1271099138,3cyclictest0-21swapper/311:46:413
1271099132,6cyclictest0-21swapper/311:40:003
1271099132,6cyclictest0-21swapper/307:55:013
12710991311,1cyclictest0-21swapper/309:12:073
12710991310,2cyclictest0-21swapper/311:42:273
12710991310,2cyclictest0-21swapper/310:30:123
12710991310,2cyclictest0-21swapper/309:50:153
12710991310,2cyclictest0-21swapper/309:20:523
1271099130,3cyclictest18208-21sh11:14:273
1271099130,2cyclictest0-21swapper/312:10:183
1271099130,2cyclictest0-21swapper/309:35:523
1271099130,12cyclictest0-21swapper/312:36:083
1271099130,12cyclictest0-21swapper/312:36:073
1271099130,12cyclictest0-21swapper/310:05:203
1271099130,12cyclictest0-21swapper/309:30:113
1271099130,12cyclictest0-21swapper/309:30:103
1271099130,11cyclictest0-21swapper/311:55:323
12709991311,1cyclictest0-21swapper/209:05:172
12709991310,2cyclictest0-21swapper/210:30:162
12709991310,2cyclictest0-21swapper/209:21:032
1270999130,2cyclictest28733-21diskmemload10:46:132
1270999130,2cyclictest0-21swapper/210:26:042
1270999130,2cyclictest0-21swapper/208:50:122
1270999130,2cyclictest0-21swapper/207:46:042
12708991310,2cyclictest28733-21diskmemload09:50:161
12708991310,2cyclictest0-21swapper/112:20:271
12708991310,2cyclictest0-21swapper/110:18:261
12708991310,2cyclictest0-21swapper/110:13:061
12708991310,2cyclictest0-21swapper/109:35:361
12708991310,2cyclictest0-21swapper/108:25:191
12708991310,2cyclictest0-21swapper/107:35:201
1270899130,2cyclictest0-21swapper/111:46:081
1270899130,2cyclictest0-21swapper/110:05:161
1270899130,12cyclictest0-21swapper/112:25:381
1270899130,12cyclictest0-21swapper/112:07:271
1270899130,12cyclictest0-21swapper/111:27:061
1270899130,12cyclictest0-21swapper/111:02:561
1270899130,12cyclictest0-21swapper/110:32:271
1270799139,2cyclictest21002-21apt-get07:30:120
1270799132,6cyclictest0-21swapper/010:35:000
1270799132,6cyclictest0-21swapper/008:40:000
12707991310,2cyclictest0-21swapper/012:36:020
12707991310,2cyclictest0-21swapper/012:36:020
12707991310,2cyclictest0-21swapper/009:20:330
1270799130,2cyclictest0-21swapper/011:45:120
1270799130,2cyclictest0-21swapper/010:50:110
1270799130,12cyclictest0-21swapper/012:21:010
1270799130,12cyclictest0-21swapper/012:00:120
1270799130,12cyclictest0-21swapper/011:00:180
1270799130,11cyclictest0-21swapper/010:46:200
39542120,2sleep00-21swapper/011:33:000
276672120,0sleep0101ktimersoftd/007:45:160
1271099129,2cyclictest0-21swapper/312:25:193
1271099129,2cyclictest0-21swapper/311:52:083
1271099129,2cyclictest0-21swapper/311:27:143
1271099129,2cyclictest0-21swapper/310:46:583
1271099129,2cyclictest0-21swapper/310:35:313
1271099129,2cyclictest0-21swapper/309:47:233
1271099129,2cyclictest0-21swapper/308:20:123
1271099127,3cyclictest14085-21munin-node3
1271099120,11cyclictest0-21swapper/310:50:133
1271099120,11cyclictest0-21swapper/310:00:063
1271099120,11cyclictest0-21swapper/309:16:163
1271099120,11cyclictest0-21swapper/307:25:493
1270999121,6cyclictest0-21swapper/207:20:002
1270999120,2cyclictest0-21swapper/212:10:462
1270999120,11cyclictest0-21swapper/211:55:082
1270999120,11cyclictest0-21swapper/210:15:092
1270999120,11cyclictest0-21swapper/208:31:022
1270899129,2cyclictest0-21swapper/110:43:261
1270899129,2cyclictest0-21swapper/109:47:451
1270899129,2cyclictest0-21swapper/108:35:171
1270899123,6cyclictest28733-21diskmemload12:31:011
1270899122,8cyclictest27174-21cpuspeed_turbos09:05:131
1270899122,7cyclictest0-21swapper/108:52:011
1270899121,9cyclictest18963-21munin-node1
1270899121,9cyclictest0-21swapper/107:10:121
1270899120,2cyclictest0-21swapper/111:08:241
1270899120,2cyclictest0-21swapper/109:17:201
1270899120,11cyclictest0-21swapper/111:30:521
1270899120,11cyclictest0-21swapper/110:20:241
1270899120,11cyclictest0-21swapper/108:48:361
1270899120,11cyclictest0-21swapper/108:30:131
1270899120,11cyclictest0-21swapper/108:00:191
1270899120,11cyclictest0-21swapper/107:45:511
1270899120,11cyclictest0-21swapper/107:30:201
1270799129,2cyclictest0-21swapper/012:28:480
1270799129,2cyclictest0-21swapper/011:37:590
1270799129,2cyclictest0-21swapper/010:27:110
1270799129,2cyclictest0-21swapper/009:59:290
1270799129,2cyclictest0-21swapper/009:36:480
1270799129,2cyclictest0-21swapper/009:32:410
1270799129,2cyclictest0-21swapper/009:32:400
1270799129,2cyclictest0-21swapper/007:15:120
1270799127,3cyclictest27093-21aten2.4_r3power09:05:120
1270799123,6cyclictest13668-21ssh10:00:590
1270799122,7cyclictest0-21swapper/012:19:010
1270799122,7cyclictest0-21swapper/010:23:020
1270799122,5cyclictest0-21swapper/007:35:000
1270799120,2cyclictest0-21swapper/010:56:020
1270799120,2cyclictest0-21swapper/009:46:260
1270799120,2cyclictest0-21swapper/009:17:440
1270799120,11cyclictest0-21swapper/011:25:180
1270799120,11cyclictest0-21swapper/007:26:000
1270799120,10cyclictest0-21swapper/012:06:280
179872110,2sleep30-21swapper/307:20:363
1271099118,2cyclictest0-21swapper/307:45:153
1271099116,3cyclictest3728-21runrttasks08:25:043
1271099112,7cyclictest0-21swapper/308:45:013
1271099112,7cyclictest0-21swapper/308:18:593
1271099110,8cyclictest0-21swapper/307:31:583
1270999118,2cyclictest0-21swapper/208:25:042
1270999110,2cyclictest0-21swapper/207:56:052
1270999110,1cyclictest0-21swapper/207:31:052
1270899118,2cyclictest0-21swapper/109:59:271
1270899112,7cyclictest0-21swapper/108:22:591
1270899110,9cyclictest22902-21munin-node1
1270899110,2cyclictest0-21swapper/112:15:251
1270899110,2cyclictest0-21swapper/107:41:011
1270899110,10cyclictest0-21swapper/111:11:111
1270799118,2cyclictest0-21swapper/012:30:110
1270799118,2cyclictest0-21swapper/009:25:120
1270799118,2cyclictest0-21swapper/008:30:200
1270799118,2cyclictest0-21swapper/008:20:160
1270799118,2cyclictest0-21swapper/008:15:120
1270799111,7cyclictest0-21swapper/008:51:010
1270799111,6cyclictest0-21swapper/007:56:010
1270799110,8cyclictest0-21swapper/007:51:010
1270799110,2cyclictest0-21swapper/011:52:180
1270799110,1cyclictest0-21swapper/011:40:070
1271099107,2cyclictest0-21swapper/310:20:413
1271099107,2cyclictest0-21swapper/308:40:303
1271099107,2cyclictest0-21swapper/308:05:143
1271099107,2cyclictest0-21swapper/307:10:123
1271099100,6cyclictest0-21swapper/307:16:013
1270999105,3cyclictest14517-21sshd07:12:352
1270999100,8cyclictest0-21swapper/208:44:562
1270899107,2cyclictest0-21swapper/108:10:291
1270799105,3cyclictest4843-21aten2.4-expect08:10:120
1270799105,3cyclictest25833-21open_files09:00:170
1270799105,3cyclictest19116-21cpuspeed_turbos08:45:120
1270799101,7cyclictest17910-21sshd08:40:350
127109994,3cyclictest4988-21tr08:10:123
127109994,3cyclictest3728-21runrttasks09:02:153
127109994,3cyclictest31129-21aten2.4_r3power07:55:113
127109994,3cyclictest23481-21grep07:35:153
127109994,3cyclictest20676-21cron08:50:003
127109994,3cyclictest15783-21proc_pri08:35:193
127089994,3cyclictest29186-21tail07:50:101
127089990,8cyclictest6759-21munin-node1
127079994,3cyclictest2959-21df_abs08:05:150
127079994,3cyclictest17548-21hwlatdetect07:20:140
127079994,3cyclictest11182-21df_abs08:25:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional