You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-07 - 12:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sun Jun 07, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22573998518,59cyclictest0-21swapper/323:11:343
219499850,5rtkit-daemon2193-21rtkit-daemon00:12:242
219499850,5rtkit-daemon2193-21rtkit-daemon00:12:242
22573998026,46cyclictest32150-21grep23:46:533
22573997926,32cyclictest0-21swapper/321:03:593
219499790,4rtkit-daemon2193-21rtkit-daemon19:20:130
22573997833,27cyclictest22216-21cpuspeed_turbos00:21:343
219499780,4rtkit-daemon2193-21rtkit-daemon21:27:080
219499780,4rtkit-daemon2193-21rtkit-daemon21:27:080
22573997634,15cyclictest16429-21needreboot00:11:463
22573997634,15cyclictest16429-21needreboot00:11:463
22573997628,40cyclictest30483-21smartctl21:21:493
22573997618,51cyclictest0-21swapper/300:17:163
22573997519,41cyclictest15312-21diskmemload22:55:173
22573997519,41cyclictest15312-21diskmemload22:55:173
22573997424,42cyclictest29627-21df22:56:383
22573997424,42cyclictest29627-21df22:56:383
22573997423,30cyclictest25896-21ssh22:01:573
22573997420,47cyclictest0-21swapper/321:07:493
22573997326,32cyclictest9341-21users21:36:593
22573997321,33cyclictest0-21swapper/300:26:323
22573997313,53cyclictest0-21swapper/321:51:493
22573997230,24cyclictest4856-21cut21:31:453
22573997223,42cyclictest0-21swapper/300:01:553
22573997221,29cyclictest0-21swapper/323:06:513
22573997221,27cyclictest1124-21snmpd22:21:593
22573997216,37cyclictest30421-21ssh22:09:563
22573997216,37cyclictest30421-21ssh22:09:563
219499720,5rtkit-daemon2193-21rtkit-daemon19:06:440
22573997129,35cyclictest22562-21head22:46:353
22573997129,33cyclictest30865-21hwlatdetect19:16:523
22573997127,36cyclictest3331-21ssh21:29:353
22573997127,36cyclictest3331-21ssh21:29:353
22573997126,39cyclictest24613-21ssh23:36:403
22573997120,43cyclictest1-21systemd23:56:543
22573997120,43cyclictest0-21swapper/320:46:513
22573997120,30cyclictest31923-21perl22:11:453
22573997119,46cyclictest0-21swapper/323:02:543
22573997118,47cyclictest12334-21ssh00:06:363
22573997118,45cyclictest0-21swapper/320:51:493
22573997118,45cyclictest0-21swapper/320:51:493
22573997115,36cyclictest0-21swapper/322:31:563
2257099718,56cyclictest0-21swapper/022:56:580
2257099718,56cyclictest0-21swapper/022:56:580
22573997025,38cyclictest14334-21diskstats23:21:393
22573997023,40cyclictest0-21swapper/322:36:433
22573997023,31cyclictest2861-21grep22:16:433
22573997021,42cyclictest0-21swapper/321:17:263
22573997020,33cyclictest0-21swapper/322:01:203
22573997019,44cyclictest0-21swapper/319:06:553
22573997016,34cyclictest0-21swapper/323:51:523
22573996926,36cyclictest9026-21taskset19:37:153
22573996916,46cyclictest0-21swapper/322:43:263
22573996916,31cyclictest0-21swapper/321:46:393
22573996914,47cyclictest0-21swapper/321:11:373
22573996829,32cyclictest21302-21gltestperf23:31:423
22573996829,32cyclictest21302-21gltestperf23:31:423
22573996821,42cyclictest0-21swapper/323:18:563
22573996819,42cyclictest15312-21diskmemload23:27:203
22573996818,43cyclictest0-21swapper/323:45:003
2257299684,48cyclictest0-21swapper/200:09:162
22573996725,26cyclictest24570-21users19:02:063
22573996721,39cyclictest1084-21lldpd22:30:343
22573996619,40cyclictest0-21swapper/319:27:033
22573996619,40cyclictest0-21swapper/319:27:033
22573996618,31cyclictest0-21swapper/319:26:323
22573996617,42cyclictest0-21swapper/320:36:583
22573996617,31cyclictest0-21swapper/321:44:403
22573996617,29cyclictest0-21swapper/320:21:303
22573996616,42cyclictest0-21swapper/320:32:213
2257099665,53cyclictest0-21swapper/022:21:410
22573996519,38cyclictest0-21swapper/319:41:423
2257099645,52cyclictest0-21swapper/023:36:400
22570996424,33cyclictest19989-21http_loadtime21:06:490
219499640,6rtkit-daemon15163-21perl19:51:493
22573996320,36cyclictest29245-21taskset20:21:453
22573996312,45cyclictest0-21swapper/320:26:443
219499630,7rtkit-daemon0-21swapper/121:33:450
22573996231,25cyclictest28976-21sendmail_mailqu19:12:013
22573996219,25cyclictest1080-21lldpd20:01:043
2257099624,49cyclictest19496-21ls00:16:400
219499620,7rtkit-daemon0-21swapper/123:19:260
219499620,7rtkit-daemon0-21swapper/123:04:270
219499620,7rtkit-daemon0-21swapper/122:45:350
219499620,7rtkit-daemon0-21swapper/122:12:290
219499620,7rtkit-daemon0-21swapper/120:46:550
219499620,7rtkit-daemon0-21swapper/100:04:540
219499620,6rtkit-daemon25744-21vmstat20:12:043
219499620,5rtkit-daemon7191-21strings20:41:553
22573996114,30cyclictest0-21swapper/319:46:503
2257299614,37cyclictest0-21swapper/221:57:022
219499610,7rtkit-daemon0-21swapper/123:59:550
219499610,7rtkit-daemon0-21swapper/119:27:430
219499610,7rtkit-daemon0-21swapper/119:27:430
219499610,11rtkit-daemon2193-21rtkit-daemon23:52:101
2257299604,39cyclictest0-21swapper/221:24:302
2257299604,38cyclictest0-21swapper/220:37:042
22570996041,12cyclictest0-21swapper/000:06:310
2257099604,47cyclictest0-21swapper/021:21:420
219499600,7rtkit-daemon0-21swapper/122:20:140
219499600,7rtkit-daemon0-21swapper/122:07:440
219499600,7rtkit-daemon0-21swapper/122:07:440
219499600,7rtkit-daemon0-21swapper/121:41:450
219499600,7rtkit-daemon0-21swapper/119:41:200
219499600,6rtkit-daemon0-21swapper/123:42:250
219499600,6rtkit-daemon0-21swapper/123:07:340
219499600,5rtkit-daemon2193-21rtkit-daemon21:50:521
219499600,5rtkit-daemon2193-21rtkit-daemon21:33:151
219499600,4rtkit-daemon2193-21rtkit-daemon23:09:191
22573995926,26cyclictest23307-21head20:07:043
22573995926,26cyclictest23307-21head20:07:043
2257299594,37cyclictest0-21swapper/200:26:362
2257299593,48cyclictest1227-21runrttasks22:42:272
22572995925,9cyclictest1227-21runrttasks22:21:422
2257099597,44cyclictest0-21swapper/022:01:120
22570995937,14cyclictest0-21swapper/023:46:560
219499590,7rtkit-daemon0-21swapper/123:14:040
219499590,7rtkit-daemon0-21swapper/122:35:200
219499590,7rtkit-daemon0-21swapper/121:15:460
219499590,6rtkit-daemon0-21swapper/123:30:560
219499590,6rtkit-daemon0-21swapper/120:52:470
219499590,6rtkit-daemon0-21swapper/120:52:470
219499590,5rtkit-daemon2193-21rtkit-daemon22:52:571
219499590,5rtkit-daemon2193-21rtkit-daemon22:52:571
219499590,5rtkit-daemon2193-21rtkit-daemon00:01:471
22573995831,20cyclictest13991-21gltestperf20:56:483
22573995827,24cyclictest21417-21latency_hist20:06:303
2257299584,46cyclictest0-21swapper/223:02:152
2257299584,37cyclictest0-21swapper/222:41:152
2257299584,37cyclictest0-21swapper/221:44:372
22572995813,28cyclictest0-21swapper/221:46:332
2257099587,45cyclictest27571-21ls22:06:260
219499580,7rtkit-daemon0-21swapper/121:52:220
219499580,7rtkit-daemon0-21swapper/121:49:520
219499580,7rtkit-daemon0-21swapper/120:44:020
219499580,6rtkit-daemon0-21swapper/121:19:530
219499580,5rtkit-daemon2193-21rtkit-daemon22:58:051
219499580,5rtkit-daemon2193-21rtkit-daemon22:58:051
219499580,5rtkit-daemon2193-21rtkit-daemon22:40:581
219499580,5rtkit-daemon2193-21rtkit-daemon22:14:291
219499580,5rtkit-daemon2193-21rtkit-daemon21:59:591
219499580,5rtkit-daemon2193-21rtkit-daemon21:23:381
219499580,5rtkit-daemon2193-21rtkit-daemon21:21:161
219499580,5rtkit-daemon2193-21rtkit-daemon00:07:171
219499580,4rtkit-daemon2924-21strings23:51:470
219499580,4rtkit-daemon2193-21rtkit-daemon22:48:571
219499580,4rtkit-daemon2193-21rtkit-daemon21:41:001
57852572,47sleep10-21swapper/122:21:371
326422573,7sleep132759-21df19:21:461
22573995732,19cyclictest5741-21hwlatdetect19:31:513
2257299574,38cyclictest0-21swapper/223:26:452
2257299574,36cyclictest0-21swapper/223:08:332
22570995736,12cyclictest0-21swapper/022:29:510
219499570,7rtkit-daemon0-21swapper/122:54:350
219499570,7rtkit-daemon0-21swapper/122:54:350
219499570,7rtkit-daemon0-21swapper/121:39:300
219499570,6rtkit-daemon0-21swapper/121:03:170
219499570,5rtkit-daemon2193-21rtkit-daemon23:47:181
219499570,5rtkit-daemon2193-21rtkit-daemon23:16:341
219499570,5rtkit-daemon2193-21rtkit-daemon22:34:501
219499570,5rtkit-daemon2193-21rtkit-daemon20:43:471
219499570,5rtkit-daemon2193-21rtkit-daemon19:16:361
219499570,4rtkit-daemon2193-21rtkit-daemon23:37:481
219499570,4rtkit-daemon2193-21rtkit-daemon23:11:421
219499570,4rtkit-daemon2193-21rtkit-daemon23:03:041
219499570,4rtkit-daemon2193-21rtkit-daemon19:39:051
219499570,4rtkit-daemon2193-21rtkit-daemon19:30:131
219499570,4rtkit-daemon2193-21rtkit-daemon19:30:131
2257299564,44cyclictest0-21swapper/223:31:512
2257299564,44cyclictest0-21swapper/223:31:512
2257299564,28cyclictest0-21swapper/223:49:402
2257299563,38cyclictest0-21swapper/222:05:462
2257299563,28cyclictest0-21swapper/223:51:422
22571995622,12cyclictest0-21swapper/121:01:491
2257099568,41cyclictest0-21swapper/020:41:280
22570995613,23cyclictest0-21swapper/000:11:340
22570995613,23cyclictest0-21swapper/000:11:340
22570995610,28cyclictest0-21swapper/020:21:440
219499560,7rtkit-daemon0-21swapper/122:36:280
219499560,7rtkit-daemon0-21swapper/119:46:270
219499560,5rtkit-daemon2193-21rtkit-daemon22:41:351
219499560,5rtkit-daemon2193-21rtkit-daemon22:01:521
219499560,5rtkit-daemon2193-21rtkit-daemon21:07:541
219499560,5rtkit-daemon2193-21rtkit-daemon20:54:541
219499560,5rtkit-daemon2193-21rtkit-daemon20:54:541
219499560,5rtkit-daemon2193-21rtkit-daemon20:46:401
219499560,5rtkit-daemon2193-21rtkit-daemon19:34:131
219499560,4rtkit-daemon2193-21rtkit-daemon23:27:111
219499560,4rtkit-daemon2193-21rtkit-daemon22:18:061
219499560,4rtkit-daemon2193-21rtkit-daemon22:11:141
219499560,4rtkit-daemon2193-21rtkit-daemon22:11:141
219499560,4rtkit-daemon2193-21rtkit-daemon21:52:071
219499560,4rtkit-daemon2193-21rtkit-daemon21:42:081
212752564,45sleep20-21swapper/221:08:092
106422563,9sleep110757-21unixbench_singl22:26:571
231432553,7sleep123165-21munin-node21:11:471
2257299554,37cyclictest0-21swapper/223:20:252
22572995523,13cyclictest0-21swapper/222:31:502
22572995515,23cyclictest0-21swapper/222:07:172
22572995515,23cyclictest0-21swapper/222:07:172
2257099557,40cyclictest0-21swapper/022:47:180
22570995540,10cyclictest0-21swapper/023:23:520
22570995510,38cyclictest0-21swapper/000:21:590
219499550,6rtkit-daemon2193-21rtkit-daemon23:24:041
219499550,6rtkit-daemon0-21swapper/123:34:410
219499550,6rtkit-daemon0-21swapper/123:34:410
219499550,5rtkit-daemon2193-21rtkit-daemon23:41:251
219499550,5rtkit-daemon2193-21rtkit-daemon23:32:561
219499550,5rtkit-daemon2193-21rtkit-daemon23:32:561
219499550,5rtkit-daemon2193-21rtkit-daemon20:57:391
219499550,5rtkit-daemon2193-21rtkit-daemon19:42:271
219499550,5rtkit-daemon2193-21rtkit-daemon19:09:141
219499550,4rtkit-daemon2193-21rtkit-daemon21:27:461
219499550,4rtkit-daemon2193-21rtkit-daemon21:27:461
219499550,4rtkit-daemon2193-21rtkit-daemon19:14:061
117512554,42sleep20-21swapper/220:51:532
117512554,42sleep20-21swapper/220:51:532
2257299546,31cyclictest0-21swapper/219:01:472
2257299545,26cyclictest0-21swapper/200:21:422
2257299544,30cyclictest0-21swapper/223:01:232
2257299544,30cyclictest0-21swapper/223:01:232
2257299544,21cyclictest0-21swapper/221:36:592
2257299544,20cyclictest0-21swapper/222:53:252
2257299544,20cyclictest0-21swapper/222:53:252
2257099549,39cyclictest0-21swapper/000:27:090
219499540,5rtkit-daemon2193-21rtkit-daemon00:11:321
219499540,5rtkit-daemon2193-21rtkit-daemon00:11:321
219499540,4rtkit-daemon2193-21rtkit-daemon23:56:321
219499540,4rtkit-daemon2193-21rtkit-daemon19:46:351
2257299535,34cyclictest0-21swapper/200:01:052
2257299534,28cyclictest0-21swapper/200:01:382
2257299534,21cyclictest0-21swapper/222:49:022
22572995323,12cyclictest0-21swapper/221:31:392
22572995314,22cyclictest0-21swapper/223:13:562
2257099535,39cyclictest0-21swapper/020:31:390
2257299525,13cyclictest0-21swapper/221:14:112
2257299524,39cyclictest0-21swapper/219:36:432
22572995234,11cyclictest30825-21head19:16:512
22572995222,12cyclictest0-21swapper/200:16:452
22572995221,13cyclictest0-21swapper/221:16:522
22572995221,13cyclictest0-21swapper/220:47:032
22572995218,21cyclictest0-21swapper/222:15:102
2257099524,40cyclictest0-21swapper/019:32:050
219499520,7rtkit-daemon0-21swapper/119:13:130
282982512,9sleep10-21swapper/100:31:031
2257299514,32cyclictest0-21swapper/219:21:522
2257299514,28cyclictest0-21swapper/221:26:572
2257299514,28cyclictest0-21swapper/221:26:572
2257299514,28cyclictest0-21swapper/219:46:442
2257299514,27cyclictest0-21swapper/221:03:442
2257299514,26cyclictest0-21swapper/222:26:472
2257299514,24cyclictest26540-21yum-updatesd-he23:40:042
2257099517,36cyclictest0-21swapper/020:56:410
2257099513,40cyclictest0-21swapper/020:01:540
22570995129,15cyclictest0-21swapper/019:56:510
2257299504,29cyclictest0-21swapper/223:41:412
2257299504,28cyclictest0-21swapper/223:24:272
2257299504,28cyclictest0-21swapper/222:16:472
2257299504,28cyclictest0-21swapper/220:06:462
2257299504,28cyclictest0-21swapper/220:06:462
2257299504,28cyclictest0-21swapper/219:41:572
2257299504,27cyclictest0-21swapper/220:22:012
22572995032,11cyclictest15247-21head19:51:502
2257299503,28cyclictest1227-21runrttasks20:21:302
22572995019,13cyclictest0-21swapper/220:31:502
22572995015,28cyclictest17747-21aten_r1power_vo21:51:382
2257099505,28cyclictest0-21swapper/020:16:520
2257099504,28cyclictest0-21swapper/020:26:480
22570995027,15cyclictest0-21swapper/019:54:040
224042504,40sleep00-21swapper/018:59:530
140692503,9sleep00-21swapper/019:50:440
249232492,9sleep10-21swapper/119:06:261
2257299494,27cyclictest0-21swapper/220:11:532
2257299493,27cyclictest0-21swapper/219:56:482
2257299493,26cyclictest0-21swapper/219:16:062
22572994919,13cyclictest0-21swapper/220:26:592
22572994919,10cyclictest14865-21grep20:57:022
2257199495,27cyclictest0-21swapper/120:21:571
2257199493,40cyclictest0-21swapper/100:21:221
2257099494,25cyclictest0-21swapper/019:01:430
22570994931,11cyclictest23964-21aten_r1power_cu20:11:400
2257299484,27cyclictest0-21swapper/220:41:532
2257299484,27cyclictest0-21swapper/219:26:432
2257299484,27cyclictest0-21swapper/219:26:432
22572994828,12cyclictest19823-21tune2fs20:01:482
22572994818,13cyclictest0-21swapper/219:32:062
2257199485,26cyclictest0-21swapper/119:57:061
2257199484,27cyclictest0-21swapper/120:02:031
22571994822,11cyclictest0-21swapper/100:19:391
22571994819,12cyclictest0-21swapper/120:06:581
22571994819,12cyclictest0-21swapper/120:06:581
2257099484,37cyclictest0-21swapper/020:11:300
2257099484,37cyclictest0-21swapper/020:11:300
22573994729,12cyclictest22580-21latency_hist19:01:333
2257299474,26cyclictest0-21swapper/219:08:232
20612473,10sleep00-21swapper/019:25:240
2257199464,26cyclictest0-21swapper/120:33:391
2257199464,12cyclictest4226-21fschecks_count20:36:461
22571994629,9cyclictest28476-21crond20:21:301
22571994617,12cyclictest0-21swapper/119:51:501
260072452,37sleep10-21swapper/120:15:271
2257199454,34cyclictest0-21swapper/120:26:411
2257199445,32cyclictest0-21swapper/119:01:341
224012434,6sleep20-21swapper/218:59:512
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional