You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-19 - 08:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Sun Apr 19, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
248599980,4rtkit-daemon2484-21rtkit-daemon21:53:012
248599960,5rtkit-daemon2484-21rtkit-daemon20:00:200
248599950,6rtkit-daemon0-21swapper/020:08:200
248599930,6rtkit-daemon0-21swapper/020:12:120
248599930,5rtkit-daemon25014-21ssh20:05:430
248599930,5rtkit-daemon25014-21ssh20:05:430
248599760,7rtkit-daemon0-21swapper/120:01:281
248599760,7rtkit-daemon0-21swapper/120:01:281
2707399714,59cyclictest0-21swapper/220:11:082
248599710,5rtkit-daemon2484-21rtkit-daemon19:22:223
248599710,4rtkit-daemon2484-21rtkit-daemon20:27:573
248599710,12rtkit-daemon2484-21rtkit-daemon20:46:113
248599700,6rtkit-daemon2484-21rtkit-daemon20:21:273
248599700,5rtkit-daemon2484-21rtkit-daemon22:16:453
248599700,5rtkit-daemon2484-21rtkit-daemon19:39:213
248599700,5rtkit-daemon2484-21rtkit-daemon18:39:533
248599700,4rtkit-daemon2484-21rtkit-daemon21:32:393
248599700,4rtkit-daemon2484-21rtkit-daemon18:55:233
248599690,6rtkit-daemon2484-21rtkit-daemon18:02:473
248599690,6rtkit-daemon2484-21rtkit-daemon17:19:573
248599690,6rtkit-daemon2484-21rtkit-daemon17:19:573
248599690,5rtkit-daemon2484-21rtkit-daemon21:16:103
248599690,5rtkit-daemon2484-21rtkit-daemon18:45:313
248599690,5rtkit-daemon2484-21rtkit-daemon18:45:313
248599690,5rtkit-daemon2484-21rtkit-daemon17:11:043
248599690,4rtkit-daemon2484-21rtkit-daemon20:59:403
248599690,4rtkit-daemon2484-21rtkit-daemon20:45:113
248599690,4rtkit-daemon2484-21rtkit-daemon19:20:373
248599690,4rtkit-daemon2484-21rtkit-daemon19:20:373
248599690,4rtkit-daemon2484-21rtkit-daemon18:56:003
248599690,4rtkit-daemon2484-21rtkit-daemon18:46:383
248599690,4rtkit-daemon2484-21rtkit-daemon18:12:543
248599690,4rtkit-daemon2484-21rtkit-daemon17:48:183
2707399684,55cyclictest0-21swapper/219:21:102
248599680,6rtkit-daemon2484-21rtkit-daemon18:25:313
248599680,5rtkit-daemon2484-21rtkit-daemon18:20:243
248599680,5rtkit-daemon2484-21rtkit-daemon17:30:193
248599680,4rtkit-daemon2484-21rtkit-daemon22:07:453
248599680,4rtkit-daemon2484-21rtkit-daemon22:07:453
248599680,4rtkit-daemon2484-21rtkit-daemon21:47:313
248599680,4rtkit-daemon2484-21rtkit-daemon21:44:313
248599680,4rtkit-daemon2484-21rtkit-daemon21:21:173
248599680,4rtkit-daemon2484-21rtkit-daemon21:21:173
248599680,4rtkit-daemon2484-21rtkit-daemon21:14:403
248599680,4rtkit-daemon2484-21rtkit-daemon19:54:133
248599680,4rtkit-daemon2484-21rtkit-daemon19:54:133
248599680,4rtkit-daemon2484-21rtkit-daemon19:28:293
248599680,4rtkit-daemon2484-21rtkit-daemon19:07:073
248599680,4rtkit-daemon2484-21rtkit-daemon17:55:103
248599680,4rtkit-daemon2484-21rtkit-daemon17:22:193
27074996718,40cyclictest26364-21iostat_ios20:06:103
2707399675,54cyclictest0-21swapper/219:31:052
248599670,6rtkit-daemon2484-21rtkit-daemon19:03:523
248599670,5rtkit-daemon2484-21rtkit-daemon21:52:313
248599670,5rtkit-daemon2484-21rtkit-daemon21:26:543
248599670,5rtkit-daemon2484-21rtkit-daemon20:53:413
248599670,5rtkit-daemon2484-21rtkit-daemon20:32:043
248599670,5rtkit-daemon2484-21rtkit-daemon20:15:203
248599670,5rtkit-daemon2484-21rtkit-daemon19:41:213
248599670,5rtkit-daemon2484-21rtkit-daemon19:13:003
248599670,5rtkit-daemon2484-21rtkit-daemon17:43:563
248599670,4rtkit-daemon2484-21rtkit-daemon21:37:243
248599670,4rtkit-daemon2484-21rtkit-daemon20:19:123
248599670,4rtkit-daemon2484-21rtkit-daemon19:55:503
248599670,4rtkit-daemon2484-21rtkit-daemon19:47:283
248599670,4rtkit-daemon2484-21rtkit-daemon17:58:253
248599670,4rtkit-daemon2484-21rtkit-daemon17:58:253
248599670,4rtkit-daemon2484-21rtkit-daemon17:36:413
202862673,12sleep00-21swapper/018:01:240
2707399665,53cyclictest0-21swapper/220:58:332
2707399663,54cyclictest0-21swapper/217:40:522
2706999664,30cyclictest0-21swapper/021:41:190
248599660,5rtkit-daemon2484-21rtkit-daemon21:07:333
248599660,5rtkit-daemon2484-21rtkit-daemon20:36:343
248599660,5rtkit-daemon2484-21rtkit-daemon17:32:193
248599660,4rtkit-daemon2484-21rtkit-daemon22:13:153
248599660,4rtkit-daemon2484-21rtkit-daemon22:02:533
248599660,4rtkit-daemon2484-21rtkit-daemon21:02:333
248599660,4rtkit-daemon2484-21rtkit-daemon19:31:443
248599660,4rtkit-daemon2484-21rtkit-daemon18:32:463
248599660,4rtkit-daemon2484-21rtkit-daemon18:26:543
248599660,4rtkit-daemon2484-21rtkit-daemon18:10:473
248599660,12rtkit-daemon0-21swapper/321:57:013
2707399654,53cyclictest0-21swapper/222:21:082
2707399654,53cyclictest0-21swapper/221:31:002
2706999654,28cyclictest0-21swapper/017:51:160
64492643,54sleep10-21swapper/117:32:431
2707399645,51cyclictest0-21swapper/220:45:572
2707399644,53cyclictest0-21swapper/219:36:222
2707399644,53cyclictest0-21swapper/218:16:022
2707399644,52cyclictest0-21swapper/221:01:022
2707399644,52cyclictest0-21swapper/220:01:052
2707399644,52cyclictest0-21swapper/220:01:052
2707399643,54cyclictest0-21swapper/219:56:192
2707399643,53cyclictest0-21swapper/219:45:592
2706999644,38cyclictest3205-21python19:31:190
2706999643,29cyclictest0-21swapper/022:05:430
2707399634,52cyclictest0-21swapper/222:10:562
2707399634,52cyclictest0-21swapper/221:11:002
2706999634,50cyclictest3718-21needreboot21:56:100
2706999633,54cyclictest0-21swapper/020:45:340
27069996320,13cyclictest0-21swapper/022:06:060
27069996320,13cyclictest0-21swapper/022:06:060
2707399624,51cyclictest6723-21cut22:01:022
2707399624,51cyclictest0-21swapper/222:25:552
2707399624,51cyclictest0-21swapper/221:55:502
2707399623,51cyclictest29738-21cpuspeed_turbos22:35:542
2707399623,51cyclictest0-21swapper/222:16:292
2706999625,29cyclictest0-21swapper/021:36:140
2706999624,30cyclictest0-21swapper/022:40:410
2706999623,53cyclictest0-21swapper/021:03:580
2706999623,52cyclictest0-21swapper/019:48:180
2706999623,51cyclictest0-21swapper/020:46:050
270942613,51sleep20-21swapper/221:43:212
2707399615,49cyclictest0-21swapper/222:08:162
2707399615,49cyclictest0-21swapper/222:08:162
2707399614,50cyclictest1419-21runrttasks20:27:232
2707399614,50cyclictest0-21swapper/219:55:422
2707399614,50cyclictest0-21swapper/219:55:422
2707399613,50cyclictest0-21swapper/221:40:442
2706999615,48cyclictest0-21swapper/020:16:070
2706999614,27cyclictest0-21swapper/020:35:580
2706999613,52cyclictest0-21swapper/021:15:590
2706999613,52cyclictest0-21swapper/020:27:200
2706999613,52cyclictest0-21swapper/019:11:180
27069996122,11cyclictest0-21swapper/021:26:000
27069996121,12cyclictest0-21swapper/020:30:550
101162613,49sleep00-21swapper/017:41:120
2707399608,35cyclictest0-21swapper/220:21:172
2707399603,51cyclictest0-21swapper/220:36:182
2707399603,50cyclictest0-21swapper/220:16:012
2707399603,50cyclictest0-21swapper/217:56:042
2707399603,50cyclictest0-21swapper/217:56:042
2706999604,49cyclictest0-21swapper/018:00:520
2706999604,49cyclictest0-21swapper/018:00:520
2706999604,49cyclictest0-21swapper/017:46:130
2706999603,51cyclictest0-21swapper/019:37:150
2706999603,50cyclictest24089-21df_inode19:16:040
2706999603,50cyclictest24089-21df_inode19:16:040
249032603,12sleep20-21swapper/220:51:172
153812603,9sleep215498-21ssh21:26:042
2707399594,49cyclictest0-21swapper/222:31:132
2706999595,48cyclictest0-21swapper/019:21:080
2706999594,48cyclictest0-21swapper/022:26:050
157782593,13sleep20-21swapper/219:01:032
2707299583,48cyclictest0-21swapper/119:16:341
2707299583,48cyclictest0-21swapper/119:16:341
2706999586,45cyclictest0-21swapper/022:21:040
27069995841,10cyclictest2887-21grep21:06:180
2706999584,48cyclictest0-21swapper/020:51:010
2706999584,47cyclictest0-21swapper/020:56:060
2706999584,30cyclictest0-21swapper/017:20:540
2706999584,30cyclictest0-21swapper/017:20:540
2706999583,49cyclictest0-21swapper/021:35:150
2706999583,48cyclictest0-21swapper/021:50:550
27074995711,38cyclictest30309-21munin-node22:36:013
2707399574,45cyclictest0-21swapper/217:31:252
2707399572,50cyclictest0-21swapper/220:33:502
2706999576,28cyclictest0-21swapper/021:50:300
2706999573,48cyclictest0-21swapper/021:11:050
27069995722,14cyclictest0-21swapper/022:11:010
248599570,6rtkit-daemon2484-21rtkit-daemon17:46:182
2707499564,43cyclictest0-21swapper/322:21:013
2707399564,44cyclictest0-21swapper/217:52:432
2707399562,49cyclictest0-21swapper/221:18:422
2706999564,27cyclictest0-21swapper/022:17:230
2706999564,27cyclictest0-21swapper/019:43:050
2706999563,45cyclictest3900-21tune2fs20:21:050
27069995622,15cyclictest0-21swapper/019:26:090
27069995621,14cyclictest0-21swapper/021:22:420
27069995621,14cyclictest0-21swapper/021:22:420
27069995621,13cyclictest0-21swapper/022:34:340
75102553,9sleep00-21swapper/018:41:300
75102553,9sleep00-21swapper/018:41:300
48482553,44sleep10-21swapper/121:58:081
2707499556,11cyclictest27502-21sendmail_mailqu22:31:123
27074995512,36cyclictest0-21swapper/322:27:593
2707399552,48cyclictest0-21swapper/219:42:372
2706999555,28cyclictest0-21swapper/019:51:210
2706999555,28cyclictest0-21swapper/019:51:210
2706999555,28cyclictest0-21swapper/019:06:200
2706999555,26cyclictest0-21swapper/018:32:520
2706999554,29cyclictest0-21swapper/017:11:290
27069995536,11cyclictest32540-21grep18:26:240
2706999553,45cyclictest0-21swapper/018:53:450
27074995412,26cyclictest23485-21munin-node20:01:193
27074995412,26cyclictest23485-21munin-node20:01:193
27069995435,12cyclictest14614-21head18:56:240
294522533,43sleep129460-21irqstats18:21:121
2707399534,43cyclictest31038-21diskstats19:26:042
2707399534,30cyclictest0-21swapper/220:40:562
27073995320,14cyclictest0-21swapper/217:26:112
2707299533,25cyclictest6696-21grep22:01:021
27072995323,13cyclictest0-21swapper/121:07:061
2706999534,28cyclictest0-21swapper/017:36:220
2706999533,41cyclictest0-21swapper/018:16:020
2706999533,27cyclictest0-21swapper/018:21:020
62622523,43sleep10-21swapper/119:36:131
54572522,43sleep10-21swapper/118:40:511
293652523,7sleep129370-21sh22:35:491
284702522,44sleep10-21swapper/122:33:231
2707399525,40cyclictest0-21swapper/221:21:132
2707399525,40cyclictest0-21swapper/221:21:132
2707399524,41cyclictest0-21swapper/218:56:132
2707399524,40cyclictest0-21swapper/218:51:082
2707399524,29cyclictest0-21swapper/218:06:092
2707399524,27cyclictest0-21swapper/220:05:512
27073995234,11cyclictest1958-21wc21:06:052
27073995225,11cyclictest0-21swapper/221:49:062
2707299524,42cyclictest0-21swapper/120:56:031
2707299524,41cyclictest0-21swapper/121:26:011
2706999525,40cyclictest0-21swapper/017:35:520
2706999524,28cyclictest0-21swapper/018:11:150
198102523,42sleep10-21swapper/121:31:191
159162522,42sleep10-21swapper/117:51:331
100032523,9sleep00-21swapper/018:47:550
2707399518,37cyclictest0-21swapper/218:31:092
2707399513,31cyclictest0-21swapper/217:11:052
2707399512,43cyclictest0-21swapper/218:11:232
2706999515,39cyclictest0-21swapper/019:01:070
206462512,42sleep20-21swapper/219:11:072
86732502,42sleep10-21swapper/120:27:251
320242502,9sleep10-21swapper/121:01:441
316302502,42sleep10-21swapper/117:18:281
316302502,42sleep10-21swapper/117:18:281
2707399504,28cyclictest0-21swapper/219:16:002
2707399504,28cyclictest0-21swapper/219:16:002
2707399504,28cyclictest0-21swapper/217:21:282
2707399504,27cyclictest0-21swapper/218:46:012
2707399504,14cyclictest0-21swapper/218:36:082
2707299504,40cyclictest0-21swapper/119:30:221
2707299504,38cyclictest0-21swapper/120:40:561
2707299504,29cyclictest0-21swapper/119:51:211
2707299504,29cyclictest0-21swapper/119:51:211
2707299504,24cyclictest0-21swapper/120:10:571
27072995013,31cyclictest14139-21gltestperf20:36:061
2706999504,30cyclictest0-21swapper/017:26:240
2546425010,30sleep30-21swapper/317:06:103
212762502,41sleep10-21swapper/122:21:381
197192502,42sleep10-21swapper/119:09:491
185452502,41sleep10-21swapper/119:55:571
115432502,42sleep10-21swapper/122:07:551
115432502,42sleep10-21swapper/122:07:551
110452502,41sleep10-21swapper/118:51:071
2707399495,37cyclictest0-21swapper/217:16:182
2707399495,37cyclictest0-21swapper/217:16:182
2707399494,37cyclictest0-21swapper/218:45:512
27073994934,9cyclictest281ktimersoftd/218:21:492
2707399493,40cyclictest0-21swapper/218:26:072
2707399493,40cyclictest0-21swapper/218:01:052
2707399493,29cyclictest0-21swapper/217:41:042
2707299494,40cyclictest0-21swapper/120:07:161
27072994924,10cyclictest17546-21timerandwakeup22:16:131
2706999494,27cyclictest0-21swapper/018:36:080
243732494,7sleep124450-21cat20:51:071
186352493,40sleep118740-21latency_hist18:00:521
186352493,40sleep118740-21latency_hist18:00:521
2707399484,26cyclictest0-21swapper/219:08:372
2707399483,28cyclictest0-21swapper/218:41:042
2707299489,22cyclictest0-21swapper/119:35:481
2707299484,28cyclictest0-21swapper/122:10:491
2707299484,27cyclictest0-21swapper/121:41:121
2707299484,12cyclictest0-21swapper/120:16:011
2707299484,12cyclictest0-21swapper/119:21:041
2707299483,40cyclictest0-21swapper/122:29:181
226092483,39sleep122636-21open_files21:36:111
129842482,40sleep10-21swapper/119:46:131
29182472,39sleep10-21swapper/118:33:501
2707299474,27cyclictest0-21swapper/118:06:221
2707299474,26cyclictest0-21swapper/121:46:531
2707299474,26cyclictest0-21swapper/118:20:511
2707299473,39cyclictest0-21swapper/121:51:241
2707299473,38cyclictest5695-21munin-node18:41:201
2707299473,38cyclictest5695-21munin-node18:41:201
2707299473,38cyclictest0-21swapper/121:24:031
2707299473,38cyclictest0-21swapper/121:24:031
2707299473,38cyclictest0-21swapper/120:24:261
27072994728,13cyclictest0-21swapper/121:11:211
2706999473,27cyclictest0-21swapper/017:21:070
267242474,6sleep00-21swapper/017:06:510
219242472,39sleep10-21swapper/120:46:401
327292462,38sleep10-21swapper/118:27:451
2707299464,25cyclictest0-21swapper/121:17:441
2707299464,25cyclictest0-21swapper/120:31:101
2707299463,39cyclictest0-21swapper/119:11:391
2706999463,24cyclictest21279-21munin-node18:06:220
108512462,38sleep10-21swapper/119:43:151
291172452,37sleep10-21swapper/117:11:471
2707299454,36cyclictest0-21swapper/118:46:101
2707299454,35cyclictest0-21swapper/117:21:211
257352452,38sleep10-21swapper/118:14:551
89362442,36sleep10-21swapper/117:39:001
208152442,36sleep10-21swapper/118:02:581
2707399434,13cyclictest0-21swapper/217:10:542
2707299433,34cyclictest0-21swapper/118:56:111
27072994328,9cyclictest3025-21tail17:26:131
2707299423,12cyclictest0-21swapper/119:01:161
27072994029,7cyclictest11010-21unixbench_multi17:41:261
27072994027,8cyclictest12010-21cpuspeed_turbos17:46:061
2707299333,25cyclictest27145-21cat17:10:541
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional