You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-20 - 00:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Thu Nov 19, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
279222960,3sleep1201ktimersoftd/109:09:061
29540999128,12cyclictest0-21swapper/009:23:360
246399830,7rtkit-daemon0-21swapper/007:03:150
246399810,4rtkit-daemon2462-21rtkit-daemon09:46:163
246399800,29rtkit-daemon0-21swapper/010:12:302
246399710,5rtkit-daemon2462-21rtkit-daemon11:11:133
246399700,5rtkit-daemon2462-21rtkit-daemon12:29:332
2954099644,54cyclictest0-21swapper/010:02:040
246399640,5rtkit-daemon2462-21rtkit-daemon08:32:123
2954099633,54cyclictest0-21swapper/011:37:550
2954099633,54cyclictest0-21swapper/011:37:550
2954899615,50cyclictest0-21swapper/311:33:013
2954899615,49cyclictest29257-21munin-node09:13:203
2954899615,49cyclictest21750-21ntp_states09:48:183
2954899615,48cyclictest1403-21runrttasks12:08:063
29545996129,27cyclictest22825-21df_abs12:17:581
29545996129,27cyclictest22825-21df_abs12:17:581
2954899605,48cyclictest0-21swapper/307:38:253
2954899605,48cyclictest0-21swapper/307:38:253
2954899605,47cyclictest1403-21runrttasks10:12:543
2954899596,47cyclictest22272-21diskmemload11:13:163
2954899596,47cyclictest1403-21runrttasks12:29:563
2954899596,46cyclictest8406-21latency_hist11:07:493
2954899595,48cyclictest14555-21aten_r1power_po10:28:013
2954899595,46cyclictest0-21swapper/310:27:513
2954899595,46cyclictest0-21swapper/310:27:513
2954799595,41cyclictest0-21swapper/209:12:542
29547995929,14cyclictest0-21swapper/208:58:092
56322583,47sleep20-21swapper/211:03:042
2954899585,47cyclictest0-21swapper/312:03:003
29548995841,12cyclictest17164-21cut07:43:123
29547995833,10cyclictest3825-21munin-node09:23:112
29547995832,9cyclictest32545-21sshd10:53:202
2954899576,46cyclictest0-21swapper/310:42:443
29548995741,10cyclictest15952-21gltestperf11:18:063
2954899574,48cyclictest0-21swapper/309:38:073
2954899574,48cyclictest0-21swapper/309:38:073
2954899574,47cyclictest0-21swapper/310:58:043
2954899574,47cyclictest0-21swapper/310:58:043
2954899574,46cyclictest0-21swapper/310:18:043
2954899574,46cyclictest0-21swapper/310:18:043
2954899573,7cyclictest24028-21ssh11:30:203
29547995734,8cyclictest2961-21ssh10:58:102
29547995734,8cyclictest2961-21ssh10:58:102
29545995725,26cyclictest12866-21ssh09:35:051
2954099574,46cyclictest0-21swapper/012:02:590
2954899565,46cyclictest0-21swapper/311:42:163
2954899565,46cyclictest0-21swapper/311:42:163
2954899564,47cyclictest0-21swapper/309:36:193
2954899564,46cyclictest19291-21cpuspeed_turbos12:12:583
29548995639,11cyclictest24348-21uniq09:53:083
29548995610,39cyclictest0-21swapper/310:33:003
2954799568,29cyclictest0-21swapper/211:07:592
2954799564,44cyclictest0-21swapper/212:03:052
29547995626,13cyclictest0-21swapper/209:38:082
29547995626,13cyclictest0-21swapper/209:38:082
268862563,11sleep20-21swapper/211:33:392
246399560,5rtkit-daemon2462-21rtkit-daemon10:28:222
246399560,5rtkit-daemon2462-21rtkit-daemon07:08:232
142462563,45sleep10-21swapper/111:15:441
81712552,46sleep00-21swapper/011:55:020
2954899556,30cyclictest0-21swapper/307:13:223
2954899555,16cyclictest0-21swapper/311:23:113
29548995541,9cyclictest1148-21gltestperf09:18:103
2954899554,44cyclictest0-21swapper/309:08:173
29548995523,11cyclictest6622-21ssh11:53:053
29547995534,7cyclictest22137-21ssh11:28:022
29547995532,8cyclictest32680-21ssh09:17:572
29547995531,9cyclictest26669-21ssh09:08:132
29547995530,8cyclictest1-21systemd09:28:032
29547995522,14cyclictest0-21swapper/211:48:172
29545995520,30cyclictest28438-21processes09:58:201
2954099554,45cyclictest0-21swapper/010:07:150
246399550,5rtkit-daemon2462-21rtkit-daemon10:23:232
246399550,5rtkit-daemon2462-21rtkit-daemon10:23:232
246399550,5rtkit-daemon2462-21rtkit-daemon07:46:292
246399550,5rtkit-daemon2462-21rtkit-daemon07:28:292
78922543,9sleep00-21swapper/008:32:300
2954899544,45cyclictest0-21swapper/311:49:093
2954899544,45cyclictest0-21swapper/311:44:183
2954899544,45cyclictest0-21swapper/310:43:113
2954899544,13cyclictest0-21swapper/310:48:143
2954899543,34cyclictest0-21swapper/307:53:183
29548995421,14cyclictest1216-21lldpd12:22:573
29548995413,34cyclictest0-21swapper/311:58:043
29547995432,8cyclictest32406-21ssh10:04:162
29547995432,7cyclictest21373-21latency_hist11:27:472
29547995427,12cyclictest0-21swapper/211:18:032
29547995425,13cyclictest0-21swapper/211:38:372
29547995425,13cyclictest0-21swapper/211:38:372
2954599543,33cyclictest22272-21diskmemload10:19:171
2954599543,33cyclictest22272-21diskmemload10:19:171
2954099544,45cyclictest0-21swapper/010:41:590
246399540,5rtkit-daemon2462-21rtkit-daemon08:23:122
246399540,5rtkit-daemon2462-21rtkit-daemon08:23:122
246399540,4rtkit-daemon2462-21rtkit-daemon10:33:072
179132544,9sleep10-21swapper/111:22:091
68402534,43sleep00-21swapper/010:14:490
53322533,10sleep00-21swapper/011:51:520
2954899535,43cyclictest0-21swapper/310:03:153
2954899533,29cyclictest0-21swapper/307:22:563
29548995312,15cyclictest0-21swapper/308:13:053
29547995337,9cyclictest20747-21cut09:48:042
29547995331,9cyclictest32588-21iostat_ios11:43:092
29547995331,8cyclictest7785-21ssh11:53:362
29547995330,7cyclictest28723-21ssh10:48:132
29547995324,13cyclictest0-21swapper/209:43:122
29547995324,12cyclictest0-21swapper/212:23:112
29547995320,20cyclictest11268-21fschecks_time09:33:092
29547995316,23cyclictest10542-21proc_pri11:58:142
2954599536,40cyclictest0-21swapper/112:07:551
2954599535,41cyclictest0-21swapper/109:13:141
2954599534,42cyclictest0-21swapper/112:23:181
2954099533,45cyclictest0-21swapper/011:33:160
246399530,5rtkit-daemon2462-21rtkit-daemon10:44:592
246399530,5rtkit-daemon2462-21rtkit-daemon10:13:232
246399530,5rtkit-daemon2462-21rtkit-daemon08:13:052
246399530,5rtkit-daemon2462-21rtkit-daemon07:23:372
149272533,7sleep10-21swapper/112:05:431
2954899525,42cyclictest0-21swapper/309:28:323
2954799527,21cyclictest7876-21ssh10:17:592
2954799527,21cyclictest7876-21ssh10:17:592
29547995236,9cyclictest12083-21cpuspeed_turbos11:13:002
29547995227,8cyclictest23353-21ssh12:18:052
29547995227,8cyclictest23353-21ssh12:18:052
2954599523,43cyclictest1348-21kworker/1:210:59:101
2954599523,43cyclictest1348-21kworker/1:210:59:101
29545995211,24cyclictest0-21swapper/111:29:591
2954099525,13cyclictest0-21swapper/009:36:040
2954099524,42cyclictest0-21swapper/012:12:560
2954099523,43cyclictest0-21swapper/010:37:420
2954099523,43cyclictest0-21swapper/009:43:170
29540995221,8cyclictest116650irq/46-eth011:13:090
246399520,5rtkit-daemon2462-21rtkit-daemon10:38:592
246399520,5rtkit-daemon2462-21rtkit-daemon07:58:132
215072523,41sleep10-21swapper/112:15:431
93142513,9sleep00-21swapper/009:29:050
79892512,9sleep10-21swapper/111:06:581
69682513,41sleep10-21swapper/109:27:491
296872512,42sleep10-21swapper/112:28:041
29548995121,13cyclictest0-21swapper/310:08:043
2954799517,26cyclictest0-21swapper/209:53:252
2954799516,26cyclictest0-21swapper/208:52:542
29547995133,12cyclictest16098-21cpuspeed_turbos12:07:582
29547995126,10cyclictest27678-21timerandwakeup08:03:262
2954599518,13cyclictest0-21swapper/110:38:031
2954599514,42cyclictest5272-21sshd08:24:261
2954599514,42cyclictest5272-21sshd08:24:261
2954599514,41cyclictest1348-21kworker/1:210:50:501
2954599514,40cyclictest3338-21ssh09:22:031
2954099514,42cyclictest0-21swapper/009:04:500
2954099514,41cyclictest0-21swapper/010:08:260
2954099514,18cyclictest0-21swapper/010:24:230
2954099514,18cyclictest0-21swapper/010:24:230
246399510,5rtkit-daemon2462-21rtkit-daemon07:37:592
246399510,5rtkit-daemon2462-21rtkit-daemon07:37:592
246399510,5rtkit-daemon2462-21rtkit-daemon07:05:152
202742512,42sleep10-21swapper/111:23:351
196462512,9sleep30-21swapper/308:54:543
16472512,44sleep00-21swapper/011:45:510
54662502,42sleep00-21swapper/008:26:580
54662502,42sleep00-21swapper/008:26:580
30732503,40sleep00-21swapper/008:21:540
30732503,40sleep00-21swapper/008:21:540
2954899505,27cyclictest0-21swapper/309:03:143
2954899504,27cyclictest0-21swapper/309:58:123
2954899504,12cyclictest32551-21grep10:53:203
2954899503,9cyclictest22883-21sh12:17:583
2954899503,9cyclictest22883-21sh12:17:583
29548995022,12cyclictest0-21swapper/308:43:163
29548995021,12cyclictest0-21swapper/309:23:223
29548995015,28cyclictest361ktimersoftd/308:33:263
29547995031,6cyclictest25281-21ssh09:06:532
2954799503,28cyclictest0-21swapper/207:13:242
29547995024,12cyclictest0-21swapper/210:01:372
2954599506,39cyclictest0-21swapper/111:10:271
2954599504,40cyclictest18838-21memory08:53:151
2954599504,40cyclictest16601-21ssh10:29:271
2954599503,41cyclictest22272-21diskmemload11:36:081
2954599503,40cyclictest25386-21ssh09:07:141
2954599503,40cyclictest0-21swapper/110:42:591
2954099505,38cyclictest0-21swapper/009:18:040
2954099505,36cyclictest29528-21munin-run07:02:580
2954099504,41cyclictest0-21swapper/010:48:000
2954099504,13cyclictest0-21swapper/011:22:410
2954099503,42cyclictest22272-21diskmemload12:10:170
29540995021,9cyclictest21106-21latency_hist07:52:570
29540995019,14cyclictest0-21swapper/009:17:530
16362503,9sleep30-21swapper/307:09:513
161022502,42sleep10-21swapper/109:39:551
161022502,42sleep10-21swapper/109:39:551
114442502,9sleep00-21swapper/007:31:320
100152502,42sleep00-21swapper/008:34:030
78092493,9sleep10-21swapper/108:31:261
306412496,9sleep10-21swapper/111:40:241
306412496,9sleep10-21swapper/111:40:241
2954899495,27cyclictest0-21swapper/308:08:223
2954899494,24cyclictest0-21swapper/307:37:283
29548994921,12cyclictest0-21swapper/308:58:043
29548994920,12cyclictest0-21swapper/307:58:243
29548994912,21cyclictest7316-21wc07:23:093
29547994936,8cyclictest12236-21unixbench_multi08:38:252
29547994921,13cyclictest0-21swapper/212:16:122
29547994921,12cyclictest0-21swapper/208:43:152
29547994921,12cyclictest0-21swapper/207:48:172
2954599496,39cyclictest0-21swapper/110:15:311
2954599495,39cyclictest0-21swapper/111:43:421
2954599495,38cyclictest0-21swapper/111:48:531
2954599495,38cyclictest0-21swapper/109:47:581
2954599494,39cyclictest0-21swapper/111:58:201
2954599494,38cyclictest3309-21ssh10:08:521
2954599493,40cyclictest1348-21kworker/1:210:54:471
29545994928,7cyclictest116650irq/46-eth009:28:511
2954099495,40cyclictest0-21swapper/009:55:480
2954099494,40cyclictest0-21swapper/011:10:110
2954099494,40cyclictest0-21swapper/010:56:190
2954099494,27cyclictest0-21swapper/009:08:310
2954099494,20cyclictest0-21swapper/010:57:580
2954099494,20cyclictest0-21swapper/010:57:580
2954099493,42cyclictest0-21swapper/010:46:450
2954099493,40cyclictest1257-21snmpd08:47:010
29540994915,28cyclictest5379-21cpu11:03:010
246399490,5rtkit-daemon2462-21rtkit-daemon07:53:212
198022493,40sleep00-21swapper/008:56:570
101412492,40sleep20-21swapper/208:35:422
2954899485,14cyclictest0-21swapper/307:28:113
2954899484,9cyclictest15898-21diskstats08:48:093
2954899484,26cyclictest0-21swapper/308:03:123
2954899483,25cyclictest0-21swapper/308:38:043
2954799484,27cyclictest0-21swapper/208:08:112
2954599486,37cyclictest0-21swapper/109:57:351
2954599484,39cyclictest0-21swapper/111:56:371
2954599484,37cyclictest304-21ssh10:05:421
2954599483,39cyclictest0-21swapper/107:23:031
29545994819,9cyclictest19526-21unixbench_multi10:33:211
2954099485,39cyclictest0-21swapper/010:28:080
2954099485,28cyclictest0-21swapper/012:19:210
2954099485,28cyclictest0-21swapper/012:19:210
2954099484,40cyclictest0-21swapper/012:31:080
2954099484,37cyclictest0-21swapper/011:58:080
2954099484,26cyclictest0-21swapper/011:23:130
2954099483,41cyclictest0-21swapper/012:27:240
246399480,5rtkit-daemon2462-21rtkit-daemon07:36:592
233982482,9sleep00-21swapper/009:52:400
219282483,39sleep00-21swapper/008:58:340
197932483,39sleep10-21swapper/109:46:281
2954899474,26cyclictest0-21swapper/308:18:103
2954899474,26cyclictest0-21swapper/308:18:103
2954899474,26cyclictest0-21swapper/307:07:583
2954899473,34cyclictest0-21swapper/307:48:063
29548994718,12cyclictest0-21swapper/308:26:563
29548994718,12cyclictest0-21swapper/308:26:563
29547994726,9cyclictest4728-21telnet07:18:082
29547994725,9cyclictest17803-21telnet08:53:032
2954599474,37cyclictest0-21swapper/110:23:011
2954599474,37cyclictest0-21swapper/110:23:011
2954599473,39cyclictest0-21swapper/109:00:221
29545994721,8cyclictest3369-21cat08:22:561
2954099474,37cyclictest0-21swapper/010:19:120
2954099474,37cyclictest0-21swapper/010:19:120
2954099474,36cyclictest0-21swapper/007:18:080
2954099473,37cyclictest0-21swapper/011:27:570
29540994728,13cyclictest0-21swapper/009:38:130
29540994728,13cyclictest0-21swapper/009:38:130
29540994720,9cyclictest16328-21latency_hist07:42:570
29540994720,9cyclictest16328-21latency_hist07:42:570
29547994621,11cyclictest0-21swapper/208:28:042
2954599465,34cyclictest0-21swapper/108:13:211
2954599465,34cyclictest0-21swapper/107:43:061
2954599465,12cyclictest16029-21runrttasks07:39:071
2954599465,12cyclictest16029-21runrttasks07:39:071
2954599463,39cyclictest0-21swapper/107:21:121
2954599463,38cyclictest0-21swapper/108:46:091
29545994629,12cyclictest0-21swapper/108:19:091
2954099464,25cyclictest0-21swapper/007:44:130
2954099464,12cyclictest0-21swapper/007:58:100
2954099463,26cyclictest0-21swapper/008:40:580
29540994628,13cyclictest0-21swapper/008:52:420
258342462,38sleep10-21swapper/108:02:161
138822463,38sleep10-21swapper/107:37:131
101952463,9sleep10-21swapper/108:36:261
2954799453,26cyclictest0-21swapper/208:18:042
2954799453,26cyclictest0-21swapper/208:18:042
2954599458,12cyclictest0-21swapper/107:03:081
2954599454,36cyclictest0-21swapper/107:53:241
2954599454,32cyclictest0-21swapper/107:08:071
29545994531,9cyclictest19314-21cpuspeed_turbos07:48:091
2954599453,38cyclictest0-21swapper/108:05:491
2954599453,36cyclictest0-21swapper/107:17:511
29545994521,9cyclictest116650irq/46-eth008:38:131
2954099454,23cyclictest1894-21crond07:12:560
29540994529,11cyclictest0-21swapper/007:55:210
29540994519,7cyclictest4400-21latency_hist07:17:570
29540994517,7cyclictest28279-21latency_hist08:07:560
2954599445,33cyclictest29543-21awk07:02:581
2954599443,36cyclictest0-21swapper/108:08:231
2954599443,35cyclictest0-21swapper/108:48:051
2954599442,38cyclictest0-21swapper/107:30:201
2954099444,34cyclictest0-21swapper/007:23:190
2954099444,26cyclictest0-21swapper/008:09:180
29540994428,12cyclictest0-21swapper/008:13:070
29540994317,11cyclictest0-21swapper/007:33:170
29548994216,8cyclictest29586-21cat07:02:583
2954799333,9cyclictest29519-21latency_hist07:02:582
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional