You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-01 - 11:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Wed Apr 01, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2485991090,4rtkit-daemon2484-21rtkit-daemon20:42:561
12110991004,89cyclictest0-21swapper/021:52:580
1211099954,83cyclictest0-21swapper/021:58:100
1211099953,85cyclictest0-21swapper/021:39:520
1211099953,85cyclictest0-21swapper/020:35:400
1211499943,82cyclictest0-21swapper/319:50:443
1211099945,81cyclictest0-21swapper/020:17:580
1211099945,81cyclictest0-21swapper/020:17:580
1211499935,82cyclictest0-21swapper/322:02:483
1211499933,81cyclictest0-21swapper/320:06:283
1211099933,84cyclictest0-21swapper/021:32:550
1211099933,82cyclictest9223-21grep19:33:020
1211099933,82cyclictest11593-21aten2.4-expect21:12:540
1211499923,81cyclictest0-21swapper/322:39:523
1211499914,79cyclictest7288-21latency21:53:013
1211099913,81cyclictest0-21swapper/020:49:040
1211099913,64cyclictest6351ssh21:43:070
1211099913,64cyclictest6351ssh21:43:070
1211099912,81cyclictest0-21swapper/022:32:500
1211499905,79cyclictest0-21swapper/320:01:383
1211499905,67cyclictest0-21swapper/320:43:333
1211499904,78cyclictest7573-21gltestperf20:18:013
1211499904,78cyclictest7573-21gltestperf20:18:013
1211499904,77cyclictest1085-21cat20:08:073
1211499902,82cyclictest0-21swapper/321:21:363
1211099904,79cyclictest0-21swapper/019:58:030
1211099904,79cyclictest0-21swapper/019:37:580
1211099904,78cyclictest0-21swapper/022:17:530
1211499894,77cyclictest0-21swapper/322:53:073
1211499894,77cyclictest0-21swapper/322:43:573
1211499893,79cyclictest0-21swapper/322:17:503
1211099893,80cyclictest0-21swapper/020:47:080
1211499884,49cyclictest0-21swapper/321:46:393
1211499884,49cyclictest0-21swapper/321:46:393
1211499883,78cyclictest4243-21grep20:13:023
1211499883,78cyclictest10724-21forks20:23:003
1211499883,77cyclictest25269-21ssh19:57:353
1211099884,77cyclictest0-21swapper/022:25:350
1211099884,76cyclictest0-21swapper/022:27:440
1211099884,76cyclictest0-21swapper/022:27:440
1211099883,78cyclictest0-21swapper/020:29:570
1211099883,78cyclictest0-21swapper/019:18:030
1211099883,76cyclictest21469-21grep20:38:060
248599870,31rtkit-daemon4992-21latency18:18:091
1211499875,73cyclictest0-21swapper/318:40:063
1211499874,75cyclictest0-21swapper/321:58:043
1211499874,75cyclictest0-21swapper/320:58:303
1211499874,75cyclictest0-21swapper/320:58:303
1211499874,75cyclictest0-21swapper/320:39:293
1211499874,74cyclictest0-21swapper/322:37:063
1211499873,77cyclictest0-21swapper/320:54:273
1211099874,76cyclictest0-21swapper/021:08:110
1211099874,76cyclictest0-21swapper/020:03:020
1211099874,75cyclictest0-21swapper/022:07:550
1211099873,79cyclictest0-21swapper/021:21:080
1211099873,78cyclictest0-21swapper/022:14:040
1211099872,79cyclictest0-21swapper/021:03:160
1211499865,72cyclictest1419-21runrttasks22:51:543
1211499864,73cyclictest28657-21cut22:27:503
1211499864,73cyclictest28657-21cut22:27:503
1211499864,61cyclictest0-21swapper/321:30:343
1211499863,74cyclictest20894-21rm21:26:093
1211099864,75cyclictest0-21swapper/021:01:380
1211099864,75cyclictest0-21swapper/021:01:380
1211099863,77cyclictest7084-21fschecks_time18:23:060
1211099863,63cyclictest0-21swapper/021:50:420
1211499854,73cyclictest0-21swapper/319:12:463
1211499854,73cyclictest0-21swapper/318:46:513
1211499854,72cyclictest0-21swapper/322:24:073
1211499854,63cyclictest0-21swapper/319:37:403
1211499853,73cyclictest28971-21ssh20:48:483
1211499853,49cyclictest29872-21sort21:38:113
1211099855,71cyclictest0-21swapper/022:53:060
1211099854,74cyclictest0-21swapper/022:48:080
1211099854,74cyclictest0-21swapper/020:14:130
1211099854,74cyclictest0-21swapper/019:47:580
1211099853,76cyclictest0-21swapper/019:46:440
1211099853,76cyclictest0-21swapper/019:46:440
1211099853,75cyclictest0-21swapper/017:29:070
1211099853,75cyclictest0-21swapper/017:29:070
1211099853,66cyclictest0-21swapper/018:04:120
248599840,11rtkit-daemon18-21rcuc/119:18:141
1211499845,71cyclictest0-21swapper/318:33:173
1211499845,58cyclictest0-21swapper/321:15:063
1211499844,73cyclictest0-21swapper/320:36:313
1211499844,73cyclictest0-21swapper/319:44:333
1211499844,73cyclictest0-21swapper/319:44:333
1211499844,62cyclictest0-21swapper/322:13:313
1211499843,75cyclictest13102-21fschecks_time17:28:083
1211499843,75cyclictest13102-21fschecks_time17:28:083
1211499843,50cyclictest4855-21munin-run19:27:433
1211099845,71cyclictest21442-21grep18:53:030
1211099845,71cyclictest21442-21grep18:53:030
1211099844,73cyclictest0-21swapper/022:03:090
1211099844,73cyclictest0-21swapper/021:28:320
1211099844,73cyclictest0-21swapper/019:28:570
1211099844,64cyclictest0-21swapper/022:47:260
1211099843,75cyclictest0-21swapper/020:23:020
1211099843,74cyclictest23582-21grep17:48:210
1211099843,74cyclictest1676-21nscd22:37:470
1211099843,74cyclictest0-21swapper/020:56:090
1211099843,74cyclictest0-21swapper/019:54:120
1211499835,69cyclictest1243-21lldpd22:10:553
1211499834,71cyclictest0-21swapper/318:18:203
1211499833,73cyclictest4846-21diskmemload21:32:553
1211499833,73cyclictest0-21swapper/321:11:123
1211499832,76cyclictest0-21swapper/319:27:583
12110998333,42cyclictest31932-21head19:13:180
1211099833,73cyclictest1419-21runrttasks21:25:420
1211099833,73cyclictest0-21swapper/018:18:140
1211099833,72cyclictest0-21swapper/019:03:050
1211099833,64cyclictest8700-21munin-node18:27:580
248599820,6rtkit-daemon12-21rcu_preempt21:19:091
248599820,11rtkit-daemon18-21rcuc/122:27:371
1211499824,71cyclictest0-21swapper/318:23:093
1211499824,70cyclictest0-21swapper/321:05:503
1211099823,72cyclictest0-21swapper/020:09:450
1211099823,72cyclictest0-21swapper/018:48:010
1211499814,69cyclictest0-21swapper/319:07:453
1211499814,61cyclictest0-21swapper/317:48:053
1211499813,56cyclictest22223-21timerandwakeup18:53:163
1211499813,56cyclictest22223-21timerandwakeup18:53:163
1211099814,70cyclictest0-21swapper/018:33:030
1211099813,72cyclictest0-21swapper/018:44:260
1211099813,72cyclictest0-21swapper/017:42:220
248599800,5rtkit-daemon1287-21snmpd20:05:501
248599800,4rtkit-daemon18-21rcuc/120:07:501
248599800,20rtkit-daemon28792-21runrttasks22:27:521
248599800,20rtkit-daemon28792-21runrttasks22:27:521
1211499805,47cyclictest0-21swapper/318:08:053
1211499804,64cyclictest0-21swapper/321:50:413
1211499804,57cyclictest121850irq/46-eth019:38:163
1211499802,72cyclictest0-21swapper/318:51:323
1211099803,71cyclictest0-21swapper/017:44:520
1211099803,70cyclictest4462-21grep19:23:150
1211099803,70cyclictest0-21swapper/018:40:110
1211099803,69cyclictest0-21swapper/017:55:430
255302790,7sleep21211399cyclictest17:53:142
248599790,5rtkit-daemon3328-21ssh20:58:331
248599790,5rtkit-daemon3328-21ssh20:58:331
1211499795,60cyclictest0-21swapper/320:29:053
1211499794,59cyclictest0-21swapper/319:02:463
1211499794,59cyclictest0-21swapper/319:02:463
1211499793,64cyclictest16703-21runrttasks17:35:383
1211099794,68cyclictest0-21swapper/018:13:150
1211099794,68cyclictest0-21swapper/018:13:150
1211099794,68cyclictest0-21swapper/018:12:470
1211099793,70cyclictest0-21swapper/019:08:010
1211099793,69cyclictest0-21swapper/017:57:580
1211099783,69cyclictest0-21swapper/017:33:210
248599770,5rtkit-daemon926-21munin-run20:57:401
248599770,5rtkit-daemon29240-21ssh20:49:481
248599770,20rtkit-daemon0-21swapper/019:43:061
248599770,20rtkit-daemon0-21swapper/019:43:061
1211499773,61cyclictest17684-21df_inode17:38:063
1211499772,70cyclictest0-21swapper/319:18:003
1211099774,58cyclictest0-21swapper/018:59:170
1211099774,58cyclictest0-21swapper/018:59:170
248599760,5rtkit-daemon11562-21ssh21:58:531
248599760,4rtkit-daemon11006-21ssh19:35:281
248599760,11rtkit-daemon0-21swapper/121:05:021
1211499762,67cyclictest19495-21munin-node17:43:013
1211499762,67cyclictest0-21swapper/318:15:253
1211499762,67cyclictest0-21swapper/318:15:253
1211099754,64cyclictest0-21swapper/017:27:480
1211499744,64cyclictest30526-21tr19:12:593
1211499743,40cyclictest10083-21processes18:28:153
1211499732,65cyclictest0-21swapper/317:59:363
1211499715,41cyclictest121850irq/46-eth017:53:053
1211499713,61cyclictest29349-21cpuspeed_turbos18:03:003
248599700,9rtkit-daemon0-21swapper/017:54:101
248599670,7rtkit-daemon1051-21rs:main1
1211499674,50cyclictest0-21swapper/317:27:493
248599660,7rtkit-daemon0-21swapper/021:56:081
248599640,8rtkit-daemon0-21swapper/120:10:422
248599620,7rtkit-daemon0-21swapper/222:52:432
248599620,6rtkit-daemon0-21swapper/019:38:511
95632614,48sleep20-21swapper/219:33:082
215252614,50sleep20-21swapper/219:51:102
14612619,8sleep10-21swapper/121:44:211
14612619,8sleep10-21swapper/121:44:211
1211399615,48cyclictest26-21rcuc/220:14:402
248599600,6rtkit-daemon0-21swapper/022:07:521
1211399594,47cyclictest0-21swapper/220:57:572
1211399594,47cyclictest0-21swapper/220:57:572
122252583,10sleep20-21swapper/220:24:072
116392584,48sleep20-21swapper/221:59:092
171052572,8sleep117243-21seq20:32:531
1211399574,46cyclictest0-21swapper/221:37:582
1211399573,47cyclictest0-21swapper/220:38:352
164092563,45sleep20-21swapper/220:32:052
1211399564,36cyclictest0-21swapper/222:12:022
51062554,45sleep20-21swapper/222:41:142
45252552,11sleep20-21swapper/219:23:402
1211399555,34cyclictest0-21swapper/220:53:352
1211399553,35cyclictest0-21swapper/222:27:572
1211399553,35cyclictest0-21swapper/222:27:572
1211299555,14cyclictest0-21swapper/122:48:111
60452542,46sleep20-21swapper/218:22:252
248599540,5rtkit-daemon2484-21rtkit-daemon22:52:362
134442542,7sleep113448-21ssh20:27:451
1211399544,43cyclictest0-21swapper/219:47:062
1211399544,43cyclictest0-21swapper/219:47:062
12113995436,10cyclictest3285-21head18:13:222
12113995436,10cyclictest3285-21head18:13:222
1211399543,44cyclictest0-21swapper/218:48:132
12113995413,23cyclictest0-21swapper/220:07:422
1211299544,27cyclictest25653-21fschecks_time21:32:561
34502533,8sleep12327-21kworker/1:222:37:591
273952534,43sleep20-21swapper/222:26:352
253772532,11sleep20-21swapper/222:19:582
213742532,11sleep10-21swapper/119:50:361
1211399535,33cyclictest0-21swapper/219:30:342
1211399534,42cyclictest0-21swapper/222:02:512
1211399534,37cyclictest0-21swapper/222:16:172
1211399534,34cyclictest0-21swapper/221:05:052
1211399534,31cyclictest0-21swapper/219:58:052
1211399534,26cyclictest0-21swapper/219:52:542
1211399533,43cyclictest0-21swapper/221:11:552
1211399533,34cyclictest705-21unixbench_singl22:33:112
1211399533,11cyclictest0-21swapper/220:43:152
1211299534,29cyclictest0-21swapper/121:48:101
12112995337,9cyclictest23104-21taskset18:57:551
12112995337,9cyclictest23104-21taskset18:57:551
222092522,11sleep10-21swapper/119:52:501
201582524,14sleep20-21swapper/221:23:302
140782522,43sleep10-21swapper/121:15:551
137782522,10sleep10-21swapper/122:53:021
12113995234,11cyclictest21446-21grep18:53:032
12113995234,11cyclictest21446-21grep18:53:032
12113995233,13cyclictest0-21swapper/222:43:002
1211299525,29cyclictest0-21swapper/122:13:121
1211299524,30cyclictest0-21swapper/120:12:581
12112995216,12cyclictest27408-21unixbench_singl19:58:151
76642512,11sleep10-21swapper/119:30:571
301912513,10sleep230192-21munin-node19:12:562
269092513,42sleep20-21swapper/220:47:462
165292512,9sleep20-21swapper/217:33:242
125922512,10sleep10-21swapper/120:25:271
1211399514,23cyclictest0-21swapper/218:12:062
12113995133,11cyclictest9059-21tr18:28:002
1211399513,42cyclictest0-21swapper/220:32:592
1211399513,22cyclictest0-21swapper/221:56:082
12112995120,24cyclictest30780-21forks19:13:021
12112995114,18cyclictest31614-21cpuspeed_turbos22:32:511
7762502,42sleep10-21swapper/118:08:261
311262502,43sleep10-21swapper/118:07:051
153292502,41sleep20-21swapper/218:38:542
130192502,42sleep10-21swapper/118:34:541
1211399504,38cyclictest0-21swapper/221:33:072
1211399504,29cyclictest0-21swapper/220:18:082
1211399504,29cyclictest0-21swapper/220:18:082
1211399504,28cyclictest0-21swapper/219:37:552
1211399503,35cyclictest32619-21sshd21:42:592
1211399503,35cyclictest32619-21sshd21:42:592
1211399503,30cyclictest14199-21ssh21:16:222
12113995020,13cyclictest0-21swapper/218:58:112
12113995020,13cyclictest0-21swapper/218:58:112
1211299505,28cyclictest0-21swapper/118:48:041
1211299504,40cyclictest0-21swapper/120:19:061
1211299504,40cyclictest0-21swapper/120:19:061
1211299504,28cyclictest0-21swapper/119:08:171
1211299504,28cyclictest0-21swapper/118:53:111
1211299504,28cyclictest0-21swapper/118:53:111
106492502,11sleep10-21swapper/121:10:431
242092492,41sleep20-21swapper/221:30:592
1211399495,26cyclictest0-21swapper/217:28:062
1211399495,26cyclictest0-21swapper/217:28:062
1211399494,28cyclictest0-21swapper/218:03:082
1211399494,27cyclictest0-21swapper/221:18:102
1211399494,27cyclictest0-21swapper/217:47:592
1211399494,12cyclictest0-21swapper/221:51:032
12113994920,12cyclictest0-21swapper/217:43:042
1211299495,24cyclictest0-21swapper/120:41:231
1211299495,12cyclictest0-21swapper/121:38:181
1211299494,38cyclictest0-21swapper/121:27:491
1211299494,38cyclictest0-21swapper/117:33:061
1211299494,28cyclictest0-21swapper/117:58:131
12112994923,12cyclictest0-21swapper/121:25:301
12112994920,12cyclictest0-21swapper/122:07:321
171032482,39sleep10-21swapper/117:37:541
134682482,38sleep10-21swapper/118:37:481
1211399484,36cyclictest0-21swapper/218:43:062
1211399484,27cyclictest0-21swapper/218:33:152
1211399484,12cyclictest0-21swapper/217:57:592
1211299485,26cyclictest0-21swapper/122:19:131
1211299484,27cyclictest22581-21fschecks_time17:48:061
1211299484,26cyclictest0-21swapper/122:43:521
1211299484,11cyclictest0-21swapper/117:44:081
297232472,10sleep20-21swapper/219:09:462
23762472,39sleep20-21swapper/219:22:112
1211399473,27cyclictest0-21swapper/217:38:142
1211299474,27cyclictest0-21swapper/119:23:181
12112994728,12cyclictest2872-21ps18:13:171
12112994728,12cyclictest2872-21ps18:13:171
12113994618,12cyclictest0-21swapper/218:23:052
1211299465,33cyclictest1419-21runrttasks18:22:591
12112994628,11cyclictest15966-21aten_r1power_fr18:42:591
12112994619,12cyclictest0-21swapper/117:29:081
12112994619,12cyclictest0-21swapper/117:29:081
12113994528,10cyclictest26248-21grep19:03:042
12113994519,7cyclictest12091-21latency_hist17:27:492
106892442,37sleep10-21swapper/118:30:431
1211299424,30cyclictest0-21swapper/117:27:491
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional