You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-22 - 04:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Mon Dec 22, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
207432125102,17sleep00-21swapper/019:05:310
21050212096,19sleep10-21swapper/119:09:281
20866211694,16sleep30-21swapper/319:07:073
2104629584,6sleep20-21swapper/219:09:252
324982750,1sleep3381ktimersoftd/300:10:273
110632740,0sleep00-21swapper/021:54:140
21117993717,18cyclictest0-21swapper/023:20:110
21118993514,19cyclictest0-21swapper/100:10:141
21117993431,2cyclictest4733-21diskmemload00:00:130
21119993317,14cyclictest20480-21ssh23:20:112
141042230,1sleep30-21swapper/300:27:103
2112099210,19cyclictest0-21swapper/321:10:123
2111999211,18cyclictest13947-21ssh22:35:122
2111999210,19cyclictest0-21swapper/220:35:122
2111899200,2cyclictest0-21swapper/123:40:121
2111799190,2cyclictest0-21swapper/021:20:100
273412180,0sleep30-21swapper/323:27:173
2111999180,16cyclictest0-21swapper/223:35:152
2111799186,8cyclictest30142-1kworker/u9:021:46:250
2111799180,16cyclictest0-21swapper/022:15:140
11292180,0sleep00-21swapper/021:42:000
21117991714,2cyclictest16815-21kworker/u8:122:41:040
2111999161,13cyclictest0-21swapper/200:20:282
47702151,2sleep30-21swapper/321:45:503
40272150,2sleep00-21swapper/022:23:310
2112099151,3cyclictest20159-21munin-run23:19:593
2111999152,7cyclictest0-21swapper/220:30:002
21119991512,2cyclictest0-21swapper/223:33:282
2111999151,12cyclictest21663-21diskstats20:30:122
21119991510,3cyclictest0-21swapper/200:34:442
2111999150,13cyclictest8776-21runrttasks23:43:532
2111999150,13cyclictest4733-21diskmemload22:55:062
2111999150,13cyclictest0-21swapper/200:39:472
2111899151,3cyclictest562-21apt-get23:35:051
21118991510,3cyclictest3764-21cat19:45:171
21118991510,3cyclictest3764-21cat19:45:171
2111899150,13cyclictest4733-21diskmemload22:30:331
2111899150,13cyclictest4733-21diskmemload21:51:421
2111899150,13cyclictest4733-21diskmemload21:21:331
2111899150,13cyclictest0-21swapper/100:17:421
202332150,0sleep10-21swapper/122:41:131
79712140,2sleep20-21swapper/222:27:242
270152140,2sleep00-21swapper/022:12:080
222722140,2sleep00-21swapper/021:29:590
21120991411,2cyclictest16060-21kworker/u8:023:54:043
2112099140,3cyclictest0-21swapper/300:31:023
2112099140,2cyclictest0-21swapper/322:46:423
2112099140,12cyclictest0-21swapper/323:13:023
2112099140,12cyclictest0-21swapper/323:09:113
2112099140,12cyclictest0-21swapper/322:36:323
2112099140,12cyclictest0-21swapper/300:00:193
2111999142,7cyclictest0-21swapper/220:05:002
21119991411,2cyclictest4733-21diskmemload23:48:082
21119991411,2cyclictest4733-21diskmemload00:07:472
21119991411,2cyclictest0-21swapper/223:15:272
21119991411,2cyclictest0-21swapper/222:50:172
21119991411,2cyclictest0-21swapper/200:15:472
2111999141,11cyclictest4733-21diskmemload21:43:022
2111999140,12cyclictest4733-21diskmemload23:59:172
2111999140,12cyclictest4733-21diskmemload22:46:022
2111999140,12cyclictest4733-21diskmemload21:46:542
2111999140,12cyclictest0-21swapper/223:50:172
2111999140,12cyclictest0-21swapper/223:06:132
2111999140,12cyclictest0-21swapper/223:00:522
2111999140,12cyclictest0-21swapper/222:19:122
2111999140,12cyclictest0-21swapper/221:35:142
2111999140,12cyclictest0-21swapper/221:30:022
2111999140,12cyclictest0-21swapper/200:13:582
21118991411,2cyclictest4733-21diskmemload21:44:431
21118991411,2cyclictest0-21swapper/123:11:331
21118991411,2cyclictest0-21swapper/100:20:531
21118991410,2cyclictest26529-21apt-get00:05:051
21118991410,2cyclictest0-21swapper/121:35:171
2111899140,2cyclictest0-21swapper/123:16:221
2111899140,12cyclictest4733-21diskmemload23:20:161
2111899140,12cyclictest0-21swapper/121:45:231
2111899140,12cyclictest0-21swapper/120:05:111
2111799149,3cyclictest32215-21ps22:55:210
21117991411,2cyclictest0-21swapper/022:45:140
2111799141,11cyclictest5466-21diskstats21:10:150
189722140,1sleep20-21swapper/222:02:582
158612140,2sleep04733-21diskmemload22:36:090
232602130,2sleep00-21swapper/022:08:060
213142130,2sleep00-21swapper/000:35:230
2112099138,3cyclictest15900-21irqstats20:15:183
2112099132,6cyclictest0-21swapper/320:25:013
2112099131,7cyclictest0-21swapper/320:55:003
21120991310,2cyclictest0-21swapper/322:10:523
21120991310,2cyclictest0-21swapper/321:56:403
21120991310,2cyclictest0-21swapper/321:52:493
21120991310,2cyclictest0-21swapper/321:43:183
21120991310,2cyclictest0-21swapper/321:00:173
21120991310,2cyclictest0-21swapper/319:10:203
2112099130,9cyclictest0-21swapper/322:56:053
2112099130,2cyclictest4733-21diskmemload00:20:513
2112099130,2cyclictest3392-21ssh22:22:183
2112099130,2cyclictest31256-21runrttasks23:31:403
2112099130,2cyclictest0-21swapper/323:56:293
2112099130,2cyclictest0-21swapper/323:36:523
2112099130,2cyclictest0-21swapper/323:00:493
2112099130,2cyclictest0-21swapper/322:54:213
2112099130,2cyclictest0-21swapper/322:28:013
2112099130,2cyclictest0-21swapper/321:22:493
2112099130,2cyclictest0-21swapper/300:35:023
2112099130,12cyclictest0-21swapper/323:20:483
2112099130,12cyclictest0-21swapper/322:03:113
2112099130,12cyclictest0-21swapper/321:32:223
2112099130,12cyclictest0-21swapper/321:17:203
2112099130,12cyclictest0-21swapper/320:10:203
2112099130,11cyclictest5190-21ssh00:16:503
2112099130,11cyclictest0-21swapper/322:40:123
21119991310,2cyclictest4733-21diskmemload21:29:392
21119991310,2cyclictest0-21swapper/223:10:162
21119991310,2cyclictest0-21swapper/222:20:192
21119991310,2cyclictest0-21swapper/222:05:172
21119991310,2cyclictest0-21swapper/221:55:042
21119991310,2cyclictest0-21swapper/221:23:202
21119991310,2cyclictest0-21swapper/221:15:092
21119991310,2cyclictest0-21swapper/221:00:142
21119991310,2cyclictest0-21swapper/200:27:182
2111999130,2cyclictest0-21swapper/221:10:072
2111999130,12cyclictest0-21swapper/222:31:282
2111999130,12cyclictest0-21swapper/221:53:242
2111899131,2cyclictest4733-21diskmemload23:26:481
21118991310,2cyclictest0-21swapper/123:31:021
21118991310,2cyclictest0-21swapper/100:25:201
2111899130,2cyclictest0-21swapper/123:50:281
2111899130,2cyclictest0-21swapper/120:40:151
2111899130,12cyclictest0-21swapper/122:47:331
2111899130,12cyclictest0-21swapper/120:35:211
2111899130,11cyclictest4733-21diskmemload22:50:281
2111899130,11cyclictest4733-21diskmemload22:04:221
2111899130,11cyclictest4733-21diskmemload21:10:361
2111899130,11cyclictest328750irq/24-eth122:15:271
2111899130,11cyclictest0-21swapper/122:25:301
2111899130,11cyclictest0-21swapper/122:21:241
2111899130,11cyclictest0-21swapper/122:14:121
2111899130,11cyclictest0-21swapper/100:00:371
2111799138,3cyclictest0-21swapper/023:35:030
2111799136,5cyclictest28832-21sh22:51:040
21117991310,2cyclictest4733-21diskmemload21:18:520
21117991310,2cyclictest0-21swapper/023:57:520
21117991310,2cyclictest0-21swapper/023:47:200
21117991310,2cyclictest0-21swapper/023:02:430
21117991310,2cyclictest0-21swapper/021:37:030
21117991310,2cyclictest0-21swapper/019:20:000
21117991310,2cyclictest0-21swapper/000:34:320
21117991310,2cyclictest0-21swapper/000:20:160
21117991310,2cyclictest0-21swapper/000:16:540
21117991310,2cyclictest0-21swapper/000:06:220
2111799130,2cyclictest0-21swapper/023:34:220
2111799130,2cyclictest0-21swapper/023:18:330
2111799130,12cyclictest4733-21diskmemload23:27:140
2111799130,12cyclictest0-21swapper/000:10:030
2111799130,11cyclictest9118-21rm23:44:320
2111799130,11cyclictest4733-21diskmemload23:05:570
2111799130,11cyclictest0-21swapper/022:00:050
161442130,2sleep00-21swapper/023:51:410
2112099129,2cyclictest19996-21ssh21:25:513
2112099129,2cyclictest0-21swapper/320:55:213
2112099127,3cyclictest29687-21munin-node3
2112099120,3cyclictest0-21swapper/319:55:173
2112099120,2cyclictest0-21swapper/321:36:103
2112099120,11cyclictest0-21swapper/323:48:123
2112099120,11cyclictest0-21swapper/323:40:303
2112099120,11cyclictest0-21swapper/322:30:503
2112099120,11cyclictest0-21swapper/322:05:383
2112099120,11cyclictest0-21swapper/320:07:083
2112099120,11cyclictest0-21swapper/319:20:203
2112099120,11cyclictest0-21swapper/300:05:293
2111999129,2cyclictest0-21swapper/223:25:032
2111999129,2cyclictest0-21swapper/222:41:132
2111999129,2cyclictest0-21swapper/221:05:172
2111999122,7cyclictest0-21swapper/219:46:592
2111999122,7cyclictest0-21swapper/219:46:592
2111999120,2cyclictest0-21swapper/220:45:202
2111999120,2cyclictest0-21swapper/220:10:212
2111999120,2cyclictest0-21swapper/200:01:182
2111999120,11cyclictest0-21swapper/222:13:052
2111999120,11cyclictest0-21swapper/219:55:182
2111999120,11cyclictest0-21swapper/219:10:202
2111899129,2cyclictest4733-21diskmemload22:06:331
2111899129,2cyclictest0-21swapper/123:55:141
2111899129,2cyclictest0-21swapper/123:01:281
2111899129,2cyclictest0-21swapper/121:55:381
2111899129,2cyclictest0-21swapper/100:35:261
2111899129,2cyclictest0-21swapper/100:30:151
2111899128,2cyclictest0-21swapper/122:37:311
2111899127,3cyclictest0-21swapper/120:00:101
2111899121,9cyclictest7648-21tail23:05:121
2111899121,9cyclictest0-21swapper/122:55:151
2111899121,9cyclictest0-21swapper/121:05:151
2111899121,9cyclictest0-21swapper/119:10:191
2111899121,6cyclictest0-21swapper/120:35:011
2111899121,3cyclictest233492chrt19:15:131
2111899121,3cyclictest0-21swapper/120:45:191
2111899120,2cyclictest0-21swapper/123:45:231
2111899120,2cyclictest0-21swapper/121:33:191
2111899120,2cyclictest0-21swapper/119:40:201
2111899120,11cyclictest0-21swapper/121:25:141
2111899120,11cyclictest0-21swapper/121:17:351
2111899120,11cyclictest0-21swapper/119:35:131
2111799129,2cyclictest21335-21apt-get19:10:110
2111799129,2cyclictest0-21swapper/023:12:160
2111799129,2cyclictest0-21swapper/022:25:440
2111799129,2cyclictest0-21swapper/021:55:170
2111799129,2cyclictest0-21swapper/020:50:060
2111799129,2cyclictest0-21swapper/000:28:220
2111799123,6cyclictest0-21swapper/020:06:040
2111799120,2cyclictest0-21swapper/021:33:220
2111799120,2cyclictest0-21swapper/020:20:180
2111799120,11cyclictest0-21swapper/022:32:120
2111799120,11cyclictest0-21swapper/020:35:230
2111799120,11cyclictest0-21swapper/020:15:140
2111799120,11cyclictest0-21swapper/020:10:220
2111799120,11cyclictest0-21swapper/019:20:150
47572110,2sleep30-21swapper/319:50:013
2112099118,2cyclictest27478-21kworker/u8:219:45:053
2112099118,2cyclictest27478-21kworker/u8:219:45:053
2112099118,2cyclictest0-21swapper/320:40:183
2112099110,10cyclictest0-21swapper/320:38:073
2112099110,10cyclictest0-21swapper/319:15:263
2111999112,7cyclictest0-21swapper/220:08:592
2111999112,6cyclictest0-21swapper/219:50:592
2111899117,2cyclictest0-21swapper/119:25:181
2111899113,6cyclictest0-21swapper/120:51:121
2111899111,8cyclictest0-21swapper/119:30:181
2111899111,5cyclictest0-21swapper/120:20:011
2111899110,9cyclictest13521-21tr20:10:171
2111899110,9cyclictest0-21swapper/120:55:211
2111799113,6cyclictest0-21swapper/019:40:230
2111799110,2cyclictest0-21swapper/020:30:150
2112099103,5cyclictest23319-21kworker/u8:220:45:323
2112099102,7cyclictest0-21swapper/320:02:013
2112099102,7cyclictest0-21swapper/319:35:593
2112099102,7cyclictest0-21swapper/319:32:593
2112099100,6cyclictest0-21swapper/320:28:053
2111999105,3cyclictest32467-21cut20:55:262
2111999105,3cyclictest29915-21fschecks_time19:30:142
2111999105,3cyclictest28777-21head19:25:282
2111999100,2cyclictest0-21swapper/220:23:512
2111899101,7cyclictest15898-21iostat_ios20:15:171
2111899101,3cyclictest0-21swapper/119:50:151
2111899100,8cyclictest25731-21df_abs19:20:141
2111899100,3cyclictest0-21swapper/121:00:121
2111799107,2cyclictest0-21swapper/020:40:240
2111799105,3cyclictest7380-21tr19:55:150
2111799105,3cyclictest5713-21cat19:50:150
2111799105,3cyclictest29701-21df19:30:130
2111799104,4cyclictest3679-21cut19:45:170
2111799104,4cyclictest3679-21cut19:45:160
2111799102,6cyclictest0-21swapper/021:06:160
2111799102,6cyclictest0-21swapper/019:35:580
2111799101,5cyclictest0-21swapper/021:00:000
2111799101,5cyclictest0-21swapper/020:45:010
2111799100,6cyclictest0-21swapper/020:25:010
211209996,2cyclictest4503-21kworker/u8:120:34:053
211209994,3cyclictest28226-21needreboot19:25:183
211209994,3cyclictest2717-21latency_hist21:05:003
211199994,3cyclictest30680-21unixbench_multi20:50:272
211199994,3cyclictest25652-21df_abs20:40:152
211199994,3cyclictest25404-21tail19:20:132
211199994,3cyclictest24294-21wc19:15:202
211199994,3cyclictest1966-21pzem_energy19:40:182
211199994,3cyclictest16861-21sshd20:18:082
211199991,3cyclictest0-21swapper/219:35:122
211189994,3cyclictest19614-21df_abs20:25:121
211189990,8cyclictest0-21swapper/119:55:161
211179995,3cyclictest1928-21pzem_current21:00:200
211179994,3cyclictest10093-21ntp_states20:00:150
211209983,3cyclictest1220-21tr19:40:113
211179980,7cyclictest0-21swapper/019:25:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional