You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-12 - 17:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Wed Nov 12, 2025 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
243799900,5rtkit-daemon2436-21rtkit-daemon07:42:130
243799820,5rtkit-daemon2436-21rtkit-daemon10:43:590
243799810,5rtkit-daemon2436-21rtkit-daemon11:45:490
243799810,4rtkit-daemon2436-21rtkit-daemon10:05:000
243799800,5rtkit-daemon2436-21rtkit-daemon11:02:210
243799800,5rtkit-daemon2436-21rtkit-daemon08:24:040
243799800,4rtkit-daemon2436-21rtkit-daemon10:28:520
243799800,4rtkit-daemon2436-21rtkit-daemon08:38:560
243799790,5rtkit-daemon2436-21rtkit-daemon09:28:390
243799770,5rtkit-daemon2436-21rtkit-daemon08:02:280
243799770,4rtkit-daemon2436-21rtkit-daemon12:02:180
243799770,4rtkit-daemon2436-21rtkit-daemon12:02:180
243799760,4rtkit-daemon2436-21rtkit-daemon12:32:470
243799760,4rtkit-daemon2436-21rtkit-daemon12:23:550
243799750,6rtkit-daemon0-21swapper/007:33:510
243799750,5rtkit-daemon2436-21rtkit-daemon11:23:350
243799750,4rtkit-daemon2436-21rtkit-daemon11:03:430
243799700,5rtkit-daemon2436-21rtkit-daemon09:43:310
243799680,4rtkit-daemon2436-21rtkit-daemon08:28:420
243799680,4rtkit-daemon2436-21rtkit-daemon08:28:420
243799680,4rtkit-daemon2436-21rtkit-daemon07:08:300
243799670,5rtkit-daemon2436-21rtkit-daemon12:13:250
243799670,4rtkit-daemon2436-21rtkit-daemon10:22:370
243799670,4rtkit-daemon2436-21rtkit-daemon08:37:490
243799660,4rtkit-daemon2436-21rtkit-daemon11:13:200
243799660,4rtkit-daemon2436-21rtkit-daemon11:13:200
243799660,4rtkit-daemon2436-21rtkit-daemon07:28:290
243799650,5rtkit-daemon0-21swapper/209:06:030
243799640,4rtkit-daemon2436-21rtkit-daemon09:23:320
238632633,51sleep123948-21grep07:28:301
243799610,13rtkit-daemon2436-21rtkit-daemon08:18:270
13372996142,13cyclictest0-21swapper/208:08:262
243799600,13rtkit-daemon2436-21rtkit-daemon12:33:170
243799600,13rtkit-daemon2436-21rtkit-daemon07:48:280
243799600,13rtkit-daemon2436-21rtkit-daemon07:48:280
218032603,22sleep00-21swapper/010:48:160
1337399602,52cyclictest0-21swapper/310:04:353
13372996041,13cyclictest0-21swapper/207:53:372
223822593,48sleep20-21swapper/207:23:482
1337299593,50cyclictest4762-21awk12:28:002
243799580,5rtkit-daemon2436-21rtkit-daemon11:36:191
243799560,5rtkit-daemon2436-21rtkit-daemon12:28:251
243799560,5rtkit-daemon2436-21rtkit-daemon11:43:491
243799560,4rtkit-daemon2436-21rtkit-daemon11:28:421
243799560,4rtkit-daemon2436-21rtkit-daemon08:53:561
134892563,45sleep10-21swapper/111:38:151
13373995642,8cyclictest3676-21latency_hist11:18:033
13373995642,8cyclictest3676-21latency_hist11:18:033
307032553,8sleep330854-21fschecks_time12:13:193
304892553,44sleep330517-21switchtime08:48:413
243799550,5rtkit-daemon2436-21rtkit-daemon10:08:381
243799550,5rtkit-daemon2436-21rtkit-daemon08:43:031
243799550,5rtkit-daemon2436-21rtkit-daemon08:02:501
243799550,4rtkit-daemon2436-21rtkit-daemon12:08:401
243799550,4rtkit-daemon2436-21rtkit-daemon11:04:131
243799550,4rtkit-daemon2436-21rtkit-daemon09:23:541
243799550,4rtkit-daemon2436-21rtkit-daemon09:04:031
13373995538,11cyclictest0-21swapper/311:08:293
1337099555,30cyclictest0-21swapper/109:33:331
1337099554,45cyclictest0-21swapper/112:13:341
1337099554,31cyclictest287502expr07:38:311
79162543,44sleep18021-21unixbench_multi09:08:421
79162543,44sleep18021-21unixbench_multi09:08:421
49342543,44sleep34959-21iostat_ios09:03:323
243799540,5rtkit-daemon2436-21rtkit-daemon10:58:361
243799540,4rtkit-daemon2436-21rtkit-daemon12:02:411
243799540,4rtkit-daemon2436-21rtkit-daemon12:02:411
243799540,4rtkit-daemon2436-21rtkit-daemon10:23:521
243799540,4rtkit-daemon2436-21rtkit-daemon09:47:161
243799540,4rtkit-daemon2436-21rtkit-daemon09:18:471
243799540,4rtkit-daemon2436-21rtkit-daemon08:48:561
243799540,4rtkit-daemon2436-21rtkit-daemon07:33:591
243799540,4rtkit-daemon2436-21rtkit-daemon07:09:071
13373995438,10cyclictest26068-21sshd10:54:473
13372995437,12cyclictest0-21swapper/209:33:202
1337099544,32cyclictest0-21swapper/112:18:201
13367995435,12cyclictest24493-21tr10:53:170
35632533,9sleep00-21swapper/009:01:280
309802533,9sleep00-21swapper/008:50:270
243799530,6rtkit-daemon2436-21rtkit-daemon12:08:250
243799530,5rtkit-daemon2436-21rtkit-daemon08:29:041
243799530,5rtkit-daemon2436-21rtkit-daemon08:29:041
243799530,5rtkit-daemon2436-21rtkit-daemon08:13:351
243799530,4rtkit-daemon2436-21rtkit-daemon12:33:471
243799530,4rtkit-daemon2436-21rtkit-daemon11:55:331
243799530,4rtkit-daemon2436-21rtkit-daemon11:23:571
243799530,4rtkit-daemon2436-21rtkit-daemon11:18:571
243799530,4rtkit-daemon2436-21rtkit-daemon11:18:571
243799530,4rtkit-daemon2436-21rtkit-daemon11:08:501
243799530,4rtkit-daemon2436-21rtkit-daemon10:48:511
243799530,4rtkit-daemon2436-21rtkit-daemon10:44:211
243799530,4rtkit-daemon2436-21rtkit-daemon10:29:141
243799530,4rtkit-daemon2436-21rtkit-daemon10:18:521
243799530,4rtkit-daemon2436-21rtkit-daemon10:02:231
243799530,4rtkit-daemon2436-21rtkit-daemon09:53:461
243799530,4rtkit-daemon2436-21rtkit-daemon09:53:461
243799530,4rtkit-daemon2436-21rtkit-daemon09:29:321
243799530,4rtkit-daemon2436-21rtkit-daemon08:58:551
243799530,4rtkit-daemon2436-21rtkit-daemon08:24:271
243799530,4rtkit-daemon2436-21rtkit-daemon07:48:511
243799530,4rtkit-daemon2436-21rtkit-daemon07:48:511
1337399534,42cyclictest0-21swapper/307:38:113
1336799535,23cyclictest18414-21aten2.4-expect07:18:240
13367995322,13cyclictest0-21swapper/009:13:210
95082522,9sleep30-21swapper/308:05:323
46552523,9sleep00-21swapper/007:54:450
243799520,4rtkit-daemon2436-21rtkit-daemon08:43:410
243799520,4rtkit-daemon2436-21rtkit-daemon08:19:041
243799520,4rtkit-daemon2436-21rtkit-daemon08:03:501
243799520,4rtkit-daemon2436-21rtkit-daemon07:53:581
243799520,4rtkit-daemon2436-21rtkit-daemon07:13:591
202992523,7sleep01243-21snmpd09:36:420
1337399524,41cyclictest0-21swapper/310:08:203
1337399522,45cyclictest0-21swapper/308:37:373
1337399522,44cyclictest0-21swapper/312:28:123
1337299524,41cyclictest0-21swapper/211:08:172
1337299524,41cyclictest0-21swapper/208:28:222
1337299524,41cyclictest0-21swapper/208:28:222
1337299522,45cyclictest0-21swapper/211:18:142
1337299522,45cyclictest0-21swapper/211:18:142
1337299522,45cyclictest0-21swapper/210:08:402
1336799525,28cyclictest0-21swapper/011:53:190
13367995232,12cyclictest11851-21grep09:18:280
131002523,9sleep00-21swapper/008:13:270
119742523,42sleep00-21swapper/008:11:340
287042512,9sleep20-21swapper/211:02:452
273832512,9sleep20-21swapper/212:06:452
243799510,5rtkit-daemon2436-21rtkit-daemon11:36:040
243799510,4rtkit-daemon2436-21rtkit-daemon11:18:200
243799510,4rtkit-daemon2436-21rtkit-daemon11:18:200
13373995134,11cyclictest0-21swapper/309:58:193
1337399512,42cyclictest13517-21telnet11:38:143
1337299514,41cyclictest0-21swapper/209:53:372
1337299514,41cyclictest0-21swapper/209:53:372
1337299512,44cyclictest0-21swapper/211:48:152
13370995134,10cyclictest19001-21cut07:18:301
13370995121,13cyclictest0-21swapper/109:13:201
1336799517,31cyclictest3-21ksoftirqd/011:38:190
1336799515,28cyclictest0-21swapper/009:48:280
1336799514,31cyclictest0-21swapper/010:23:290
1336799514,29cyclictest0-21swapper/009:58:410
1336799514,29cyclictest0-21swapper/009:38:370
1336799514,28cyclictest0-21swapper/008:03:310
13367995134,10cyclictest16384-21head10:33:380
13367995134,10cyclictest16384-21head10:33:380
243799500,6rtkit-daemon2436-21rtkit-daemon08:53:410
1337299503,38cyclictest0-21swapper/212:13:132
1337299502,43cyclictest0-21swapper/210:43:182
1337299502,43cyclictest0-21swapper/208:53:162
1337299502,43cyclictest0-21swapper/208:33:202
1337299502,42cyclictest0-21swapper/212:08:142
1337299502,42cyclictest0-21swapper/211:03:172
1337299502,42cyclictest0-21swapper/209:13:412
1337299502,42cyclictest0-21swapper/208:51:532
1337099503,27cyclictest0-21swapper/107:43:471
1336799505,28cyclictest0-21swapper/009:53:270
1336799505,28cyclictest0-21swapper/009:53:270
1336799504,29cyclictest0-21swapper/007:13:350
1336799504,28cyclictest0-21swapper/011:08:260
1336799504,28cyclictest0-21swapper/010:38:260
1336799504,28cyclictest0-21swapper/010:08:210
1336799504,28cyclictest0-21swapper/009:08:370
1336799504,28cyclictest0-21swapper/009:08:370
1336799504,28cyclictest0-21swapper/007:23:450
13367995021,12cyclictest0-21swapper/011:28:050
9142492,41sleep30-21swapper/308:55:303
310292492,9sleep30-21swapper/311:06:573
286482492,41sleep30-21swapper/308:46:113
250112492,9sleep20-21swapper/212:01:542
250112492,9sleep20-21swapper/212:01:542
238492492,9sleep30-21swapper/310:51:583
165732492,41sleep30-21swapper/311:43:253
1337399494,38cyclictest0-21swapper/307:13:353
13373994934,10cyclictest0-21swapper/312:03:183
13373994924,18cyclictest2780-21munin-node07:53:443
1337399492,42cyclictest0-21swapper/309:48:203
1337399492,42cyclictest0-21swapper/309:22:463
1337399492,42cyclictest0-21swapper/307:43:413
1337399492,39cyclictest11060-21telnet11:33:143
1337299494,12cyclictest0-21swapper/209:08:082
1337299493,41cyclictest0-21swapper/211:38:192
1337299492,43cyclictest0-21swapper/207:58:412
1337299492,42cyclictest0-21swapper/210:53:152
1337299492,42cyclictest0-21swapper/210:38:152
1337299492,42cyclictest0-21swapper/210:28:372
1337299492,42cyclictest0-21swapper/209:27:462
1337299492,42cyclictest0-21swapper/207:28:222
1337299492,41cyclictest0-21swapper/209:43:172
1337299492,41cyclictest0-21swapper/209:38:202
1337299492,41cyclictest0-21swapper/209:18:232
13372994910,23cyclictest26090-1kworker/2:1H08:43:352
1337099495,28cyclictest0-21swapper/112:03:111
1337099494,30cyclictest0-21swapper/111:48:321
1337099494,30cyclictest0-21swapper/110:33:311
1337099494,30cyclictest0-21swapper/110:33:311
1337099494,30cyclictest0-21swapper/110:13:311
1337099494,30cyclictest0-21swapper/109:48:311
1337099494,29cyclictest0-21swapper/110:53:281
1337099493,27cyclictest0-21swapper/107:23:501
1336799495,28cyclictest0-21swapper/012:03:120
1336799495,27cyclictest0-21swapper/010:13:240
1336799494,28cyclictest0-21swapper/007:43:250
94962482,9sleep20-21swapper/210:21:302
94592482,9sleep20-21swapper/212:37:162
67292483,38sleep36862-21unixbench_singl10:13:413
294552482,9sleep30-21swapper/312:08:363
291692482,9sleep20-21swapper/207:38:392
221692483,7sleep322188-21python07:23:443
167202482,9sleep30-21swapper/310:37:193
167202482,9sleep30-21swapper/310:37:193
1337399488,34cyclictest0-21swapper/309:01:543
13373994833,11cyclictest0-21swapper/310:31:163
13373994832,11cyclictest0-21swapper/308:08:383
1337399482,42cyclictest0-21swapper/311:25:073
1337399482,41cyclictest0-21swapper/310:23:483
1337299485,26cyclictest0-21swapper/208:18:212
1337299484,39cyclictest0-21swapper/208:58:232
1337299484,38cyclictest0-21swapper/208:13:312
1337299483,39cyclictest0-21swapper/210:33:162
1337299483,39cyclictest0-21swapper/210:33:162
13372994828,14cyclictest0-21swapper/207:18:302
1337299482,41cyclictest0-21swapper/212:32:432
1337299482,41cyclictest0-21swapper/211:43:382
1337299482,41cyclictest0-21swapper/210:48:152
1337299482,41cyclictest0-21swapper/210:03:172
1337299482,41cyclictest0-21swapper/208:38:422
1337299482,41cyclictest0-21swapper/207:48:282
1337299482,41cyclictest0-21swapper/207:48:282
1337299482,41cyclictest0-21swapper/207:43:442
1337299482,40cyclictest0-21swapper/211:33:062
1337099484,29cyclictest0-21swapper/111:13:201
1337099484,29cyclictest0-21swapper/111:13:201
1337099484,29cyclictest0-21swapper/108:43:241
1337099484,27cyclictest0-21swapper/110:43:051
13370994819,13cyclictest0-21swapper/112:23:191
13370994816,13cyclictest0-21swapper/110:03:341
117322482,9sleep20-21swapper/210:24:322
1337399474,38cyclictest0-21swapper/309:43:063
1337399474,37cyclictest4426-21sshd12:23:493
1337399474,36cyclictest0-21swapper/311:28:173
13373994733,10cyclictest0-21swapper/308:23:303
13373994732,9cyclictest15102-21cut08:18:243
13373994732,11cyclictest0-21swapper/309:55:233
13373994732,11cyclictest0-21swapper/309:55:233
13373994723,18cyclictest23470-21df_abs09:43:203
1337399472,41cyclictest0-21swapper/309:09:513
1337399472,41cyclictest0-21swapper/309:09:513
1337399472,40cyclictest0-21swapper/310:58:153
1337399472,40cyclictest0-21swapper/310:38:363
1337399472,39cyclictest0-21swapper/307:58:243
13372994732,9cyclictest8933-21tr11:28:172
1337299473,39cyclictest0-21swapper/210:02:522
1337299473,37cyclictest5116-21tail10:13:192
1337299472,41cyclictest0-21swapper/207:08:442
1337299472,40cyclictest0-21swapper/212:18:122
1337299472,40cyclictest0-21swapper/211:13:172
1337299472,40cyclictest0-21swapper/211:13:172
1337299472,40cyclictest0-21swapper/208:23:402
1337099474,29cyclictest0-21swapper/108:08:451
1337099474,27cyclictest0-21swapper/108:33:221
1336799474,27cyclictest0-21swapper/011:48:260
1336799474,26cyclictest0-21swapper/012:18:130
95592462,38sleep30-21swapper/310:22:203
214162462,9sleep30-21swapper/308:30:113
214162462,9sleep30-21swapper/308:30:113
20862462,38sleep30-21swapper/312:20:533
13373994632,10cyclictest0-21swapper/309:37:293
13373994630,10cyclictest13269-21sort08:13:283
1337399463,38cyclictest0-21swapper/309:23:343
1337399463,37cyclictest0-21swapper/310:43:203
13373994629,12cyclictest0-21swapper/308:38:423
1337399462,40cyclictest0-21swapper/309:13:223
1337399462,39cyclictest0-21swapper/311:48:133
1337299465,35cyclictest0-21swapper/209:08:252
1337299465,35cyclictest0-21swapper/209:08:252
1337299464,37cyclictest0-21swapper/211:23:332
1337299464,35cyclictest0-21swapper/209:28:182
1337299463,37cyclictest25422-21munin-node09:48:202
1337299462,39cyclictest0-21swapper/211:53:182
94252452,37sleep30-21swapper/312:36:493
278892452,36sleep30-21swapper/307:38:153
198052453,36sleep319887-21munin-node07:18:453
1337399454,35cyclictest0-21swapper/311:18:263
1337399454,35cyclictest0-21swapper/311:18:263
1337399453,35cyclictest0-21swapper/311:58:023
1337399452,38cyclictest0-21swapper/307:48:353
1337399452,38cyclictest0-21swapper/307:48:353
1337299453,38cyclictest0-21swapper/207:13:252
1337299452,39cyclictest0-21swapper/207:33:452
131342454,6sleep10-21swapper/107:05:381
131342454,6sleep10-21swapper/107:05:381
131282454,6sleep00-21swapper/007:05:330
131282454,6sleep00-21swapper/007:05:330
1337399445,34cyclictest0-21swapper/307:13:073
13373994428,10cyclictest24203-21grep11:58:283
13373994428,10cyclictest24203-21grep11:58:283
1337299442,37cyclictest0-21swapper/208:03:252
129922444,33sleep30-21swapper/307:03:473
129922444,33sleep30-21swapper/307:03:473
1337099433,23cyclictest20650-21munin-node09:38:351
1337399424,32cyclictest0-21swapper/309:28:193
1337399402,34cyclictest0-21swapper/307:28:293
1337299373,29cyclictest0-21swapper/207:08:132
1337299373,29cyclictest0-21swapper/207:08:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional