You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-03 - 10:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Mon Aug 03, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991050,6rtkit-daemon2193-21rtkit-daemon21:13:520
1588899979,19cyclictest0-21swapper/220:08:252
1588899974,25cyclictest0-21swapper/222:28:192
15888999519,12cyclictest0-21swapper/222:48:522
1588899945,24cyclictest0-21swapper/222:18:052
1588899944,24cyclictest0-21swapper/223:01:092
1588899937,24cyclictest0-21swapper/223:07:142
1588899937,24cyclictest0-21swapper/223:07:142
1588899935,25cyclictest0-21swapper/221:49:552
1588899934,26cyclictest0-21swapper/220:23:212
1588899934,26cyclictest0-21swapper/220:23:212
1588899925,25cyclictest0-21swapper/220:13:172
1588899924,24cyclictest1227-21runrttasks20:48:022
1588899924,24cyclictest0-21swapper/221:32:022
1588899919,23cyclictest0-21swapper/220:55:022
1588899914,25cyclictest0-21swapper/221:03:492
1588899914,13cyclictest0-21swapper/218:48:122
1588899904,79cyclictest0-21swapper/220:33:262
1588899904,29cyclictest0-21swapper/220:03:192
1588899904,28cyclictest0-21swapper/220:28:042
1588899904,27cyclictest0-21swapper/219:08:222
1588899904,26cyclictest0-21swapper/222:23:072
1588899904,26cyclictest0-21swapper/222:23:072
1588899904,26cyclictest0-21swapper/222:13:202
1588899904,24cyclictest0-21swapper/223:25:012
1588899903,25cyclictest0-21swapper/221:38:112
15888999020,11cyclictest0-21swapper/220:17:562
15888999012,20cyclictest107550irq/46-eth019:33:112
1588899894,29cyclictest0-21swapper/218:27:572
1588899894,26cyclictest0-21swapper/221:19:402
1588899893,28cyclictest8629-21diskmemload21:56:562
15888998917,12cyclictest0-21swapper/221:36:572
15888998911,18cyclictest0-21swapper/222:34:242
1588899885,27cyclictest0-21swapper/222:07:122
1588899884,70cyclictest0-21swapper/222:12:272
1588899884,23cyclictest15407-21latency22:43:112
1588899883,27cyclictest0-21swapper/219:58:172
1588899875,26cyclictest0-21swapper/219:48:062
1588899875,24cyclictest0-21swapper/223:15:452
1588899875,24cyclictest0-21swapper/222:38:382
1588899875,22cyclictest0-21swapper/221:12:152
1588899874,76cyclictest0-21swapper/220:58:222
1588899874,76cyclictest0-21swapper/220:58:222
1588899874,27cyclictest0-21swapper/218:17:512
1588899874,26cyclictest0-21swapper/222:55:392
1588899874,25cyclictest0-21swapper/223:34:492
1588899874,24cyclictest0-21swapper/222:02:442
1588899873,27cyclictest0-21swapper/223:28:002
15886998730,36cyclictest0-21swapper/019:13:190
1588899868,22cyclictest0-21swapper/221:16:292
1588899865,24cyclictest0-21swapper/223:21:122
1588899864,74cyclictest0-21swapper/218:18:202
1588899864,74cyclictest0-21swapper/218:18:202
1588899863,26cyclictest0-21swapper/221:23:032
1588899863,26cyclictest0-21swapper/220:47:512
15888998627,52cyclictest32180-21ps23:08:142
15886998526,49cyclictest0-21swapper/022:48:540
15886998417,59cyclictest0-21swapper/020:22:530
1588899834,71cyclictest0-21swapper/219:53:132
1588899834,71cyclictest0-21swapper/219:18:122
1588899834,28cyclictest0-21swapper/219:03:192
15888998312,12cyclictest0-21swapper/220:39:312
15886998332,44cyclictest0-21swapper/020:58:050
15886998332,44cyclictest0-21swapper/020:58:050
15886998332,33cyclictest0-21swapper/021:08:040
15886998329,46cyclictest0-21swapper/021:48:210
15888998231,43cyclictest28722-21cut18:33:132
15888998227,50cyclictest0-21swapper/221:44:362
15888998227,50cyclictest0-21swapper/221:44:362
1588899815,68cyclictest0-21swapper/218:43:262
1588899813,25cyclictest0-21swapper/219:17:552
15888998117,11cyclictest0-21swapper/218:56:492
15886998135,39cyclictest21280-21tr22:53:000
15886998121,52cyclictest0-21swapper/018:38:170
15886998033,30cyclictest30228-21head22:17:590
15886998020,54cyclictest0-21swapper/022:09:360
15888997924,48cyclictest0-21swapper/219:27:552
15886997930,41cyclictest0-21swapper/021:53:080
15886997928,43cyclictest0-21swapper/023:18:170
15886997927,16cyclictest0-21swapper/020:08:060
15886997925,48cyclictest0-21swapper/022:46:310
15886997925,47cyclictest0-21swapper/023:12:580
1588899784,25cyclictest0-21swapper/218:58:162
1588899784,22cyclictest0-21swapper/218:08:102
15886997833,28cyclictest12855-21fschecks_time20:13:110
15886997832,38cyclictest23621-21ssh21:18:070
15886997830,41cyclictest0-21swapper/020:53:130
15886997828,19cyclictest0-21swapper/020:49:050
219499770,6rtkit-daemon0-21swapper/122:12:581
1588899774,23cyclictest0-21swapper/219:43:292
1588899774,23cyclictest0-21swapper/219:43:292
15886997735,34cyclictest30795-21grep20:38:250
15886997731,40cyclictest0-21swapper/020:23:190
15886997731,40cyclictest0-21swapper/020:23:190
15886997730,40cyclictest15584-21sh23:33:060
15886997730,24cyclictest0-21swapper/022:38:130
15886997729,40cyclictest0-21swapper/020:03:050
15886997726,44cyclictest0-21swapper/023:00:180
15886997726,44cyclictest0-21swapper/022:13:410
15886997724,45cyclictest0-21swapper/021:42:120
219499760,6rtkit-daemon0-21swapper/019:41:410
15888997622,46cyclictest0-21swapper/218:38:202
15886997628,41cyclictest0-21swapper/023:10:310
15886997628,33cyclictest0-21swapper/020:33:040
15886997627,43cyclictest0-21swapper/023:23:010
15886997625,30cyclictest0-21swapper/022:00:410
15886997621,47cyclictest0-21swapper/021:29:350
1588899754,23cyclictest0-21swapper/219:28:122
1588899753,23cyclictest0-21swapper/218:28:172
15886997531,28cyclictest2695-21ssh22:23:190
15886997531,28cyclictest2695-21ssh22:23:190
15886997530,38cyclictest5348-21cut22:28:070
15886997530,15cyclictest0-21swapper/021:33:020
15886997529,39cyclictest0-21swapper/019:08:220
15886997526,43cyclictest0-21swapper/020:44:490
15886997522,44cyclictest0-21swapper/022:03:150
15886997520,48cyclictest0-21swapper/023:04:500
15886997520,48cyclictest0-21swapper/023:04:500
15886997433,35cyclictest10583-21runrttasks22:37:080
15886997430,37cyclictest22550-21grep18:18:300
15886997430,37cyclictest22550-21grep18:18:300
15886997426,31cyclictest0-21swapper/021:43:000
15886997426,31cyclictest0-21swapper/021:43:000
15886997423,43cyclictest0-21swapper/020:28:070
1588899733,21cyclictest28480-21unixbench-2d19:38:272
15886997336,32cyclictest0-21swapper/019:01:380
15886997325,32cyclictest0-21swapper/023:28:030
15886997325,14cyclictest0-21swapper/021:03:230
15886997226,39cyclictest0-21swapper/019:18:090
15886997221,45cyclictest0-21swapper/021:24:050
15886997154,11cyclictest1191-21tr18:43:160
15886997119,34cyclictest0-21swapper/019:48:100
15886997026,36cyclictest16262-21tail18:08:110
15886997026,36cyclictest15863-21latency_hist18:07:580
15886997026,14cyclictest0-21swapper/018:48:070
15886996924,30cyclictest0-21swapper/019:43:200
15886996924,30cyclictest0-21swapper/019:43:200
15886996922,31cyclictest0-21swapper/018:54:130
15886996920,42cyclictest0-21swapper/019:23:280
15886996823,20cyclictest0-21swapper/020:02:160
1588999677,46cyclictest0-21swapper/321:48:523
15886996729,30cyclictest0-21swapper/019:33:080
66392660,4sleep36766-21ls20:03:073
1588799664,24cyclictest0-21swapper/120:37:231
15886996622,36cyclictest0-21swapper/018:37:570
15886996618,42cyclictest0-21swapper/018:23:310
15886996522,37cyclictest0-21swapper/019:53:270
15886996428,30cyclictest0-21swapper/018:28:210
219499630,7rtkit-daemon0-21swapper/220:43:463
1588999633,43cyclictest0-21swapper/321:06:173
15886996337,18cyclictest22030-21munin-node19:28:250
303222622,25sleep30-21swapper/323:07:033
303222622,25sleep30-21swapper/323:07:033
15886996217,30cyclictest0-21swapper/018:17:580
15889996123,23cyclictest20685-21cpuspeed_turbos22:03:023
15886996138,17cyclictest1227-21runrttasks19:07:180
1588999594,37cyclictest0-21swapper/321:21:503
1588799594,47cyclictest0-21swapper/121:03:241
1588999582,48cyclictest0-21swapper/323:18:093
142022584,6sleep10-21swapper/118:03:151
1588999574,28cyclictest0-21swapper/323:08:293
15889995723,27cyclictest361ktimersoftd/322:17:593
219499560,6rtkit-daemon2193-21rtkit-daemon18:03:223
219499560,6rtkit-daemon0-21swapper/220:25:323
219499560,6rtkit-daemon0-21swapper/220:25:323
219499560,3rtkit-daemon6158-21ssh20:52:233
1588999564,45cyclictest0-21swapper/320:58:053
1588999564,45cyclictest0-21swapper/320:58:053
1588999564,35cyclictest0-21swapper/322:46:513
1588999564,35cyclictest0-21swapper/322:14:253
15889995620,28cyclictest25014-21sh20:31:263
15889995617,22cyclictest0-21swapper/323:15:083
15889995613,26cyclictest0-21swapper/323:35:083
219499550,4rtkit-daemon22839-21ssh22:53:343
1588999553,36cyclictest0-21swapper/321:37:393
15887995521,26cyclictest24058-21interrupts21:18:111
284742543,10sleep30-21swapper/321:24:353
219499540,4rtkit-daemon9763-21ssh21:46:143
219499540,4rtkit-daemon9763-21ssh21:46:143
219499540,4rtkit-daemon19585-21ssh22:48:413
219499540,3rtkit-daemon14565-21ssh23:32:173
1588999545,32cyclictest0-21swapper/322:58:353
1588999544,31cyclictest0-21swapper/322:27:483
1588999544,31cyclictest0-21swapper/322:27:483
1588999544,15cyclictest0-21swapper/320:36:343
1588999543,34cyclictest0-21swapper/321:57:293
1588799548,27cyclictest0-21swapper/119:33:071
219499530,5rtkit-daemon2193-21rtkit-daemon19:10:053
219499530,4rtkit-daemon1124-21snmpd21:16:523
1588999535,29cyclictest0-21swapper/322:32:473
1588999534,30cyclictest0-21swapper/321:58:023
1588999533,43cyclictest0-21swapper/320:38:193
1588799535,13cyclictest0-21swapper/120:56:501
15887995323,13cyclictest0-21swapper/123:23:031
15887995321,13cyclictest0-21swapper/120:58:071
15887995321,13cyclictest0-21swapper/120:58:071
136872533,11sleep10-21swapper/120:13:251
57892522,43sleep10-21swapper/120:50:591
239442523,10sleep30-21swapper/319:29:543
1588999529,34cyclictest0-21swapper/321:38:013
1588999525,29cyclictest0-21swapper/319:43:223
1588999525,29cyclictest0-21swapper/319:43:223
1588999525,25cyclictest17767-21ntp_states21:08:183
1588999524,29cyclictest0-21swapper/321:28:093
1588999524,29cyclictest0-21swapper/320:53:183
1588999524,29cyclictest0-21swapper/319:38:163
15889995233,12cyclictest27374-21grep18:28:313
1588999523,29cyclictest0-21swapper/323:23:153
1588999523,24cyclictest0-21swapper/322:37:583
1588799524,41cyclictest22665-21unixbench_multi22:53:201
1588799524,32cyclictest0-21swapper/120:23:091
1588799524,32cyclictest0-21swapper/120:23:091
1588799524,29cyclictest0-21swapper/118:58:151
15887995222,24cyclictest31731-21wc22:18:191
15887995216,21cyclictest0-21swapper/123:10:581
1588999519,25cyclictest0-21swapper/319:23:073
1588999515,28cyclictest0-21swapper/319:48:273
1588999514,28cyclictest0-21swapper/320:19:323
1588999514,28cyclictest0-21swapper/319:58:073
1588999514,28cyclictest0-21swapper/318:33:153
15889995110,25cyclictest0-21swapper/320:10:003
1588799515,28cyclictest0-21swapper/122:33:101
1588799514,28cyclictest0-21swapper/123:03:091
1588799514,28cyclictest0-21swapper/123:03:091
1588799514,28cyclictest0-21swapper/121:28:011
1588799514,27cyclictest0-21swapper/118:23:251
15887995120,13cyclictest0-21swapper/118:18:271
15887995120,13cyclictest0-21swapper/118:18:271
15887995111,22cyclictest0-21swapper/121:24:311
62872502,41sleep10-21swapper/121:40:301
266542502,40sleep10-21swapper/118:28:201
1588999505,27cyclictest0-21swapper/318:53:183
1588999504,28cyclictest0-21swapper/318:18:333
1588999504,28cyclictest0-21swapper/318:18:333
1588999504,27cyclictest0-21swapper/322:33:113
15889995032,11cyclictest10947-21sed19:03:153
1588799505,28cyclictest0-21swapper/123:34:301
1588799505,24cyclictest8638-21munin-run20:07:521
1588799505,11cyclictest20782-21iostat_ios21:13:121
1588799504,28cyclictest0-21swapper/122:25:331
1588799504,28cyclictest0-21swapper/122:25:331
1588799504,28cyclictest0-21swapper/119:38:231
1588799504,28cyclictest0-21swapper/119:19:181
1588799504,28cyclictest0-21swapper/119:03:301
1588799504,27cyclictest2859-21iostat23:13:091
1588799504,27cyclictest19581-21yum-updatesd-he22:48:421
1588799504,27cyclictest0-21swapper/121:59:491
1588799504,27cyclictest0-21swapper/119:13:221
1588799504,27cyclictest0-21swapper/118:53:221
1588799504,27cyclictest0-21swapper/118:13:131
1588799504,25cyclictest0-21swapper/123:22:271
1588799504,18cyclictest17528-21sendmail_mailqu18:08:271
15887995032,11cyclictest5742-21unixbench-2d19:58:261
15887995032,11cyclictest5175-21grep22:28:051
1588799503,25cyclictest0-21swapper/123:02:361
15887995024,10cyclictest22346-21munin-node20:28:221
15887995021,12cyclictest0-21swapper/121:33:091
15887995012,24cyclictest0-21swapper/122:46:211
129382502,41sleep10-21swapper/121:50:501
110422502,10sleep10-21swapper/120:10:031
34912493,9sleep30-21swapper/319:53:363
165592494,8sleep316655-21users19:13:293
1588999494,27cyclictest0-21swapper/322:08:103
1588999494,27cyclictest0-21swapper/320:14:143
1588999494,27cyclictest0-21swapper/318:58:123
1588799495,27cyclictest0-21swapper/121:44:001
1588799495,27cyclictest0-21swapper/121:44:001
1588799494,27cyclictest0-21swapper/122:40:261
1588799494,27cyclictest0-21swapper/120:46:201
1588799494,26cyclictest0-21swapper/122:03:411
1588799494,26cyclictest0-21swapper/120:22:311
1588799494,26cyclictest0-21swapper/119:48:101
1588799494,26cyclictest0-21swapper/119:44:221
1588799494,26cyclictest0-21swapper/119:44:221
1588799493,39cyclictest0-21swapper/121:56:131
15887994927,16cyclictest0-21swapper/122:08:101
15887994921,23cyclictest21110-21wc19:23:261
15887994918,10cyclictest16495-21taskset21:08:011
47232483,10sleep10-21swapper/118:48:321
252202482,9sleep30-21swapper/318:25:283
203282482,11sleep30-21swapper/318:13:553
1588999484,27cyclictest0-21swapper/319:33:113
1588999484,27cyclictest0-21swapper/318:38:133
1588799484,25cyclictest0-21swapper/120:37:571
1588799483,37cyclictest1023-21cut18:43:151
145242482,39sleep10-21swapper/119:11:381
1588999475,26cyclictest0-21swapper/318:49:133
1588999474,26cyclictest0-21swapper/319:19:183
1588799474,38cyclictest0-21swapper/118:38:501
1588799474,23cyclictest0-21swapper/118:33:141
15889994629,11cyclictest1199-21gltestperf18:43:163
1588799464,25cyclictest0-21swapper/119:29:191
15887994618,12cyclictest0-21swapper/123:30:391
37322453,36sleep10-21swapper/119:56:451
1588999454,25cyclictest0-21swapper/318:09:063
1588899372,29cyclictest0-21swapper/218:07:582
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional