You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-25 - 03:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Thu Dec 25, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
213852117106,6sleep20-21swapper/219:06:122
20575211797,12sleep10-21swapper/119:05:151
21373210998,6sleep00-21swapper/019:06:020
2139129382,6sleep30-21swapper/319:06:173
113922780,1sleep10-21swapper/121:54:591
306312680,1sleep1221ktimersoftd/121:39:411
116802590,1sleep30-21swapper/322:33:063
2171099291,2cyclictest0-21swapper/319:35:123
21710992614,2cyclictest0-21swapper/322:00:123
2170999260,16cyclictest0-21swapper/219:50:112
2170999250,2cyclictest0-21swapper/223:30:122
218582240,1sleep00-21swapper/023:24:090
322232220,0sleep30-21swapper/300:14:563
211492220,1sleep20-21swapper/222:05:232
56912210,0sleep30-21swapper/300:20:243
321962210,1sleep229-21rcuc/223:35:222
251822210,0sleep30-21swapper/321:32:303
2170999212,7cyclictest0-21swapper/219:45:002
2171099202,6cyclictest0-21swapper/320:00:003
2170999202,6cyclictest0-21swapper/222:15:012
2170799200,18cyclictest0-21swapper/021:50:110
2171099191,7cyclictest0-21swapper/322:00:013
2170799190,2cyclictest0-21swapper/023:30:120
79632180,0sleep10-21swapper/119:55:141
2171099182,6cyclictest0-21swapper/322:40:003
2170999180,16cyclictest0-21swapper/221:10:132
21708991710,5cyclictest23-21ksoftirqd/121:15:031
21708991613,2cyclictest17376-21kworker/u8:222:44:041
2170899161,13cyclictest19960-21users23:20:251
21707991613,2cyclictest3055-21kworker/u8:023:42:050
21707991613,2cyclictest17450-21kworker/u8:221:47:050
21707991613,2cyclictest12746-21kworker/u8:121:29:050
84702150,3sleep08596-21missed_timers19:55:180
2171099152,7cyclictest0-21swapper/320:10:003
2171099151,12cyclictest22259-21missed_timers22:45:173
2171099151,12cyclictest0-21swapper/300:15:113
2171099150,13cyclictest5336-21diskmemload22:28:353
2171099150,13cyclictest31160-21aten2.4_r3power21:40:123
2171099150,13cyclictest11227-21timerandwakeup21:15:263
2171099150,13cyclictest0-21swapper/300:26:363
2170999152,8cyclictest0-21swapper/220:35:012
2170999152,6cyclictest0-21swapper/223:47:012
2170999151,12cyclictest18666-21ssh22:03:072
2170999151,12cyclictest11574-21ssh00:28:102
2170999151,12cyclictest0-21swapper/223:53:332
2170999150,3cyclictest0-21swapper/221:33:322
2170899151,2cyclictest0-21swapper/100:34:041
21708991512,2cyclictest5336-21diskmemload21:42:311
21708991512,2cyclictest30459-21kworker/u8:200:00:051
21708991512,2cyclictest23203-21kworker/u8:022:56:041
21708991512,2cyclictest0-21swapper/123:10:221
21708991512,2cyclictest0-21swapper/122:32:511
21708991512,2cyclictest0-21swapper/100:28:131
2170899150,13cyclictest0-21swapper/122:50:111
2170899150,13cyclictest0-21swapper/122:11:121
21707991512,2cyclictest4358-21kworker/u8:022:38:050
21707991512,2cyclictest30086-21kworker/u8:000:11:040
21707991512,2cyclictest1504-21kworker/u8:123:05:040
2170799151,12cyclictest0-21swapper/023:12:360
2170799150,13cyclictest31801-21latency_hist19:35:000
2170799150,13cyclictest0-21swapper/021:30:140
2170799150,10cyclictest0-21swapper/019:27:050
2171099142,7cyclictest0-21swapper/323:00:003
2171099142,6cyclictest0-21swapper/323:50:013
2171099142,6cyclictest0-21swapper/321:25:013
2171099141,11cyclictest0-21swapper/323:38:233
2171099140,2cyclictest0-21swapper/321:25:103
2171099140,13cyclictest24585-21ssh23:26:153
2171099140,13cyclictest0-21swapper/323:59:253
2171099140,12cyclictest5336-21diskmemload23:00:203
2171099140,12cyclictest5336-21diskmemload00:06:273
2171099140,12cyclictest29347-21ssh23:32:113
2171099140,12cyclictest0-21swapper/323:05:143
2171099140,12cyclictest0-21swapper/322:53:523
2171099140,12cyclictest0-21swapper/321:46:103
2171099140,12cyclictest0-21swapper/321:38:403
2171099140,12cyclictest0-21swapper/300:36:363
2170999142,6cyclictest0-21swapper/220:00:002
2170999141,3cyclictest10732-21ssh21:53:512
2170999141,3cyclictest0-21swapper/200:18:342
21709991411,2cyclictest0-21swapper/223:57:312
2170999140,13cyclictest0-21swapper/222:34:382
2170999140,12cyclictest5336-21diskmemload23:08:482
2170999140,12cyclictest32374-21copy22:20:022
2170999140,12cyclictest0-21swapper/223:15:242
2170999140,12cyclictest0-21swapper/222:40:162
2170999140,12cyclictest0-21swapper/222:36:362
2170999140,12cyclictest0-21swapper/221:45:262
2170999140,12cyclictest0-21swapper/221:42:272
2170999140,12cyclictest0-21swapper/221:25:572
2170999140,12cyclictest0-21swapper/220:00:282
2170899141,2cyclictest9829-21apt-get20:00:141
21708991411,2cyclictest0-21swapper/122:20:521
21708991411,2cyclictest0-21swapper/122:05:061
21708991411,2cyclictest0-21swapper/100:20:121
2170899140,2cyclictest7354-21apt-get23:45:101
2170899140,12cyclictest5778-21ssh21:47:471
2170899140,12cyclictest5336-21diskmemload23:59:361
2170899140,12cyclictest5336-21diskmemload23:36:531
2170899140,12cyclictest5336-21diskmemload22:47:161
2170899140,12cyclictest5336-21diskmemload00:15:541
2170899140,12cyclictest0-21swapper/123:25:221
2170899140,12cyclictest0-21swapper/122:16:011
2170899140,12cyclictest0-21swapper/100:05:551
21707991411,2cyclictest30459-21kworker/u8:223:39:040
21707991411,2cyclictest30459-21kworker/u8:200:33:040
21707991411,2cyclictest29479-21kworker/u8:019:41:050
21707991411,2cyclictest24393-21kworker/u8:100:07:040
21707991411,2cyclictest21908-21kworker/u8:119:21:030
21707991411,2cyclictest17297-21kworker/u8:020:19:040
21707991411,2cyclictest15850-21kworker/u8:019:11:040
21707991411,2cyclictest0-21swapper/022:30:200
21707991410,2cyclictest8921-21ssh21:13:380
2170799140,3cyclictest5536-21grep22:25:240
2170799140,3cyclictest27836-21ps21:35:190
2170799140,2cyclictest0-21swapper/022:22:040
2170799140,2cyclictest0-21swapper/020:05:180
2170799140,12cyclictest5336-21diskmemload23:52:250
2170799140,12cyclictest5336-21diskmemload22:52:280
2170799140,12cyclictest5336-21diskmemload00:15:100
2170799140,12cyclictest0-21swapper/023:25:140
219582130,2sleep10-21swapper/119:10:111
21710991310,2cyclictest5336-21diskmemload22:20:433
21710991310,2cyclictest0-21swapper/323:40:163
21710991310,2cyclictest0-21swapper/323:10:333
21710991310,2cyclictest0-21swapper/322:15:113
21710991310,2cyclictest0-21swapper/322:13:273
21710991310,2cyclictest0-21swapper/322:05:463
21710991310,2cyclictest0-21swapper/320:10:263
21710991310,2cyclictest0-21swapper/300:00:293
2171099130,2cyclictest0-21swapper/323:53:073
2171099130,2cyclictest0-21swapper/300:31:233
2171099130,12cyclictest0-21swapper/321:10:053
2171099130,11cyclictest0-21swapper/321:54:453
21709991310,2cyclictest25520-21apt-get22:50:122
21709991310,2cyclictest0-21swapper/223:44:312
21709991310,2cyclictest0-21swapper/223:27:102
21709991310,2cyclictest0-21swapper/223:24:082
21709991310,2cyclictest0-21swapper/222:57:102
21709991310,2cyclictest0-21swapper/222:18:132
21709991310,2cyclictest0-21swapper/221:24:002
21709991310,2cyclictest0-21swapper/200:30:152
21709991310,2cyclictest0-21swapper/200:06:382
2170999130,3cyclictest0-21swapper/221:35:152
2170999130,2cyclictest0-21swapper/223:10:132
2170999130,2cyclictest0-21swapper/223:00:012
2170999130,2cyclictest0-21swapper/222:27:472
2170999130,11cyclictest5336-21diskmemload22:45:542
2170999130,11cyclictest5336-21diskmemload21:18:272
2170999130,11cyclictest0-21swapper/221:55:132
2170999130,11cyclictest0-21swapper/200:36:002
2170899132,6cyclictest0-21swapper/120:10:001
2170899131,2cyclictest0-21swapper/123:05:531
21708991310,2cyclictest5336-21diskmemload21:31:131
21708991310,2cyclictest0-21swapper/123:50:461
21708991310,2cyclictest0-21swapper/121:28:461
21708991310,2cyclictest0-21swapper/119:50:131
2170899130,2cyclictest5336-21diskmemload23:33:061
2170899130,2cyclictest0-21swapper/123:40:131
2170899130,2cyclictest0-21swapper/123:15:131
2170899130,2cyclictest0-21swapper/121:55:221
2170899130,12cyclictest0-21swapper/123:04:441
2170899130,12cyclictest0-21swapper/121:20:151
2170899130,12cyclictest0-21swapper/121:10:041
2170899130,11cyclictest5336-21diskmemload00:38:511
21707991310,2cyclictest5336-21diskmemload21:21:520
21707991310,2cyclictest5336-21diskmemload00:38:250
21707991310,2cyclictest24072-21kworker/u8:120:44:050
21707991310,2cyclictest24072-21kworker/u8:120:44:040
21707991310,2cyclictest0-21swapper/023:55:500
21707991310,2cyclictest0-21swapper/023:47:270
21707991310,2cyclictest0-21swapper/023:15:460
21707991310,2cyclictest0-21swapper/023:00:290
21707991310,2cyclictest0-21swapper/022:11:480
21707991310,2cyclictest0-21swapper/021:16:370
21707991310,2cyclictest0-21swapper/000:25:320
2170799130,2cyclictest0-21swapper/021:41:380
2170799130,2cyclictest0-21swapper/000:22:470
2170799130,1cyclictest0-21swapper/022:45:270
2170799130,12cyclictest0-21swapper/022:55:050
2170799130,12cyclictest0-21swapper/020:10:170
2170799130,11cyclictest5336-21diskmemload22:07:510
310372120,8sleep06675-21snmpd19:30:220
301142120,2sleep10-21swapper/100:10:451
2171099129,2cyclictest0-21swapper/323:20:393
2171099129,2cyclictest0-21swapper/323:15:303
2171099129,2cyclictest0-21swapper/322:44:193
2171099127,3cyclictest24343-21cut19:15:133
2171099122,7cyclictest0-21swapper/321:08:593
2171099122,7cyclictest0-21swapper/320:45:013
2171099122,7cyclictest0-21swapper/320:30:003
2171099122,7cyclictest0-21swapper/319:54:583
2171099122,6cyclictest0-21swapper/320:55:003
2171099120,11cyclictest0-21swapper/320:55:203
2171099120,11cyclictest0-21swapper/319:45:163
2170999129,2cyclictest23931-21apt-get19:15:102
2170999129,2cyclictest0-21swapper/221:05:222
2170999129,2cyclictest0-21swapper/221:00:162
2170999129,2cyclictest0-21swapper/220:15:112
2170999122,7cyclictest0-21swapper/219:32:012
2170999121,8cyclictest4192-21ssh00:20:012
2170999120,11cyclictest21938-21ssh00:01:062
2170999120,11cyclictest0-21swapper/220:45:202
2170999120,11cyclictest0-21swapper/220:20:252
2170999120,11cyclictest0-21swapper/200:11:142
2170899129,2cyclictest0-21swapper/122:00:051
2170899128,2cyclictest0-21swapper/120:35:111
2170899120,2cyclictest0-21swapper/120:10:131
2170899120,2cyclictest0-21swapper/119:35:201
2170899120,11cyclictest0-21swapper/122:35:261
2170899120,11cyclictest0-21swapper/121:00:141
2170899120,11cyclictest0-21swapper/119:20:161
2170899120,10cyclictest5336-21diskmemload22:25:271
2170799129,2cyclictest24072-21kworker/u8:120:55:040
2170799129,2cyclictest21908-21kworker/u8:119:19:050
2170799129,2cyclictest21637-21kworker/u8:220:30:040
2170799129,2cyclictest17297-21kworker/u8:020:47:050
2170799129,2cyclictest1113-21kworker/u8:119:46:040
2170799129,2cyclictest0-21swapper/022:01:430
2170799129,2cyclictest0-21swapper/021:55:450
2170799120,2cyclictest0-21swapper/000:03:160
2170799120,1cyclictest0-21swapper/019:50:120
2170799120,11cyclictest0-21swapper/022:41:540
2170799120,11cyclictest0-21swapper/022:15:410
2170799120,11cyclictest0-21swapper/020:50:170
2170799120,11cyclictest0-21swapper/020:35:160
2170799120,11cyclictest0-21swapper/020:25:200
2171099112,7cyclictest0-21swapper/320:02:593
2171099111,4cyclictest0-21swapper/319:45:003
2171099110,10cyclictest0-21swapper/319:30:173
2170999118,2cyclictest0-21swapper/220:05:292
2170999118,2cyclictest0-21swapper/219:35:202
2170999112,7cyclictest0-21swapper/219:46:022
2170999112,7cyclictest0-21swapper/219:28:022
2170999112,6cyclictest0-21swapper/220:10:242
2170999111,7cyclictest0-21swapper/220:42:582
2170999111,7cyclictest0-21swapper/220:42:582
2170999111,7cyclictest0-21swapper/219:13:592
2170999110,10cyclictest0-21swapper/220:30:162
2170899119,1cyclictest0-21swapper/120:40:241
2170899119,1cyclictest0-21swapper/120:40:241
2170899119,1cyclictest0-21swapper/119:45:131
2170899118,2cyclictest0-21swapper/120:20:171
2170899111,8cyclictest5431-21sort21:10:001
2170899111,8cyclictest0-21swapper/119:30:141
2170899111,5cyclictest0-21swapper/119:20:011
2170799118,2cyclictest0-21swapper/021:00:120
2171099107,2cyclictest0-21swapper/319:25:043
2171099102,7cyclictest0-21swapper/320:15:583
2170999107,2cyclictest0-21swapper/220:55:272
2170999105,3cyclictest31310-21grep20:50:272
2170999101,7cyclictest27576-21chrt19:22:502
2170899108,1cyclictest0-21swapper/120:55:241
2170899107,2cyclictest17297-21kworker/u8:020:49:041
2170899106,2cyclictest0-21swapper/120:25:151
2170899105,3cyclictest30808-21tail20:50:181
2170899101,5cyclictest0-21swapper/120:35:001
2170899100,8cyclictest0-21swapper/120:15:121
2170899100,2cyclictest0-21swapper/119:40:181
2170799102,6cyclictest0-21swapper/020:20:310
2170799100,5cyclictest0-21swapper/021:08:040
217109994,3cyclictest25982-21aten2.4_r3power20:40:113
217109994,3cyclictest25982-21aten2.4_r3power20:40:103
217109994,3cyclictest20995-21sensors_temp20:25:253
217109994,3cyclictest18112-21tr20:20:123
217109994,3cyclictest0-21swapper/321:00:123
217109993,4cyclictest26327-21grep19:20:143
217109991,3cyclictest0-21swapper/319:10:153
217099996,2cyclictest0-21swapper/220:25:032
217079991,4cyclictest0-21swapper/020:05:010
217109983,3cyclictest24229-21df_abs20:35:143
217089983,3cyclictest28097-21aten2.4_r3power19:25:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional