You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-17 - 11:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Tue Mar 17, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
729099933,83cyclictest0-21swapper/120:51:571
729099933,83cyclictest0-21swapper/120:51:571
7290998616,50cyclictest6851-21ssh20:37:161
185332860,9sleep0728899cyclictest18:02:230
185332860,9sleep0728899cyclictest18:02:230
729099845,71cyclictest1419-21runrttasks22:51:081
729099838,37cyclictest20307-21ssh21:46:561
729099834,70cyclictest5332-21fschecks_time22:12:001
729099814,69cyclictest0-21swapper/120:32:171
729099813,71cyclictest0-21swapper/119:04:441
729099806,51cyclictest0-21swapper/119:56:431
729099805,56cyclictest0-21swapper/120:24:401
729099805,53cyclictest0-21swapper/121:07:111
729099804,68cyclictest9441-21head23:06:511
729099804,68cyclictest1449-21ntp_states19:42:121
729099804,42cyclictest26538-21grep22:42:131
729099803,49cyclictest12169-21sh21:33:331
729099803,49cyclictest12169-21sh21:33:331
729099795,65cyclictest0-21swapper/121:27:131
729099788,49cyclictest0-21swapper/120:56:561
729099787,65cyclictest0-21swapper/122:36:481
729099786,55cyclictest0-21swapper/121:57:331
729099786,53cyclictest0-21swapper/121:06:441
729099785,67cyclictest0-21swapper/120:15:031
729099784,67cyclictest25138-21munin-run19:26:471
729099784,66cyclictest19789-21ssh20:09:241
729099784,66cyclictest19789-21ssh20:09:241
729099784,65cyclictest0-21swapper/119:37:101
729099783,56cyclictest0-21swapper/120:18:171
7290997824,47cyclictest4351-21tune2fs19:47:031
729099777,52cyclictest0-21swapper/120:28:061
729099777,50cyclictest0-21swapper/118:16:551
729099775,66cyclictest0-21swapper/117:47:081
729099775,56cyclictest0-21swapper/122:01:541
729099774,65cyclictest7304-21sort17:41:511
729099774,65cyclictest0-21swapper/121:12:061
729099774,56cyclictest15737-21ssh20:02:181
729099773,51cyclictest0-21swapper/123:01:501
729099768,60cyclictest0-21swapper/120:44:461
729099767,53cyclictest0-21swapper/119:58:081
729099767,50cyclictest0-21swapper/122:28:091
729099764,51cyclictest0-21swapper/122:21:551
729099764,51cyclictest0-21swapper/117:42:161
729099763,54cyclictest0-21swapper/122:07:311
729099756,62cyclictest0-21swapper/118:27:021
729099755,47cyclictest0-21swapper/122:59:361
729099755,47cyclictest0-21swapper/122:59:361
729099753,55cyclictest0-21swapper/120:48:311
729099753,54cyclictest0-21swapper/118:22:111
729099753,51cyclictest4065-21tail21:22:021
729099743,63cyclictest8001-21aten_r1power_en22:16:541
729099743,63cyclictest8001-21aten_r1power_en22:16:541
729099743,55cyclictest0-21swapper/117:56:521
7290997411,40cyclictest32312-21diskmemload21:42:021
729099737,48cyclictest0-21swapper/119:16:491
729099737,44cyclictest4850-1kworker/1:0H18:11:501
729099736,45cyclictest0-21swapper/122:51:591
729099735,47cyclictest29282-21sshd19:32:181
729099734,61cyclictest0-21swapper/119:26:581
729099734,61cyclictest0-21swapper/119:26:581
729099733,49cyclictest0-21swapper/122:31:521
729099733,39cyclictest0-21swapper/121:16:581
7290997318,49cyclictest24094-21fschecks_time21:51:591
729099727,49cyclictest0-21swapper/121:39:451
729099723,60cyclictest21342-21fschecks_time19:17:071
729099705,44cyclictest0-21swapper/119:07:041
729099704,59cyclictest16824-21sh18:01:511
729099703,59cyclictest313741munin-node18:32:131
729099693,48cyclictest8086-21runrttasks18:47:301
729099683,57cyclictest0-21swapper/118:42:071
729099683,48cyclictest0-21swapper/118:11:541
729099673,48cyclictest0-21swapper/118:52:011
729099663,55cyclictest1971-21munin-node18:37:051
248599660,6rtkit-daemon2484-21rtkit-daemon22:26:472
729099643,54cyclictest0-21swapper/118:58:091
7290996322,32cyclictest17266-21cpu18:02:041
7290996322,32cyclictest17266-21cpu18:02:041
53892624,12sleep30-21swapper/323:00:513
53892624,12sleep30-21swapper/323:00:513
88022613,51sleep00-21swapper/023:05:560
7288996142,13cyclictest0-21swapper/022:27:040
7291996012,41cyclictest0-21swapper/221:22:042
248599600,4rtkit-daemon2484-21rtkit-daemon22:16:322
248599600,4rtkit-daemon2484-21rtkit-daemon19:42:082
729199594,48cyclictest0-21swapper/219:52:072
729199593,48cyclictest0-21swapper/220:11:592
728899594,49cyclictest0-21swapper/020:16:190
295192594,48sleep00-21swapper/022:00:330
729299584,37cyclictest0-21swapper/322:01:413
728899584,32cyclictest0-21swapper/022:56:540
728899584,32cyclictest0-21swapper/022:56:540
303752580,6sleep2729199cyclictest19:37:012
248599580,3rtkit-daemon2484-21rtkit-daemon21:15:042
728899575,12cyclictest0-21swapper/022:07:060
308832573,47sleep30-21swapper/322:50:353
305402573,7sleep030543-21sh22:49:190
7288995638,11cyclictest28094-21cpuspeed_turbos19:32:000
728899563,28cyclictest0-21swapper/022:21:540
63302563,11sleep20-21swapper/219:49:592
327212563,10sleep00-21swapper/020:27:340
298262562,10sleep30-21swapper/320:24:183
248599560,6rtkit-daemon2484-21rtkit-daemon19:25:240
248599560,5rtkit-daemon2484-21rtkit-daemon22:55:532
729299555,45cyclictest0-21swapper/321:26:423
729199554,44cyclictest0-21swapper/220:32:082
729199554,43cyclictest0-21swapper/220:47:122
7288995518,32cyclictest15511-21switchtime20:02:160
248599550,5rtkit-daemon2484-21rtkit-daemon22:22:092
86932544,13sleep00-21swapper/018:52:010
729299545,29cyclictest10544-21munin-node19:57:113
729199545,41cyclictest0-21swapper/222:36:492
729199544,43cyclictest0-21swapper/221:56:522
729199543,43cyclictest0-21swapper/221:27:002
7291995415,31cyclictest9409-21rt-features22:17:122
7291995415,31cyclictest9409-21rt-features22:17:122
728899544,44cyclictest41ktimersoftd/021:34:360
728899544,44cyclictest41ktimersoftd/021:34:360
728899544,44cyclictest0-21swapper/020:24:220
728899544,31cyclictest0-21swapper/017:57:010
728899543,44cyclictest0-21swapper/019:55:390
7288995417,22cyclictest0-21swapper/020:47:370
248599540,5rtkit-daemon2484-21rtkit-daemon22:31:542
105862543,44sleep20-21swapper/223:07:072
729299539,26cyclictest0-21swapper/322:35:473
729299537,26cyclictest0-21swapper/320:29:093
729299536,27cyclictest24539-21memory21:52:063
729299535,29cyclictest0-21swapper/320:59:103
729299535,23cyclictest32312-21diskmemload20:47:133
729299534,33cyclictest0-21swapper/321:45:073
729299534,33cyclictest0-21swapper/321:02:173
729299533,34cyclictest0-21swapper/322:54:563
729299533,24cyclictest0-21swapper/322:27:083
7292995320,13cyclictest4242-21diskstats19:47:023
7292995319,15cyclictest0-21swapper/321:31:283
7292995315,22cyclictest5919-21fschecks_count20:37:013
728899533,44cyclictest0-21swapper/021:02:160
728899533,42cyclictest0-21swapper/021:36:450
51052535,7sleep00-21swapper/017:37:020
249212533,44sleep00-21swapper/022:41:530
248599530,5rtkit-daemon2484-21rtkit-daemon22:07:403
248599530,5rtkit-daemon2484-21rtkit-daemon19:52:153
238042532,44sleep20-21swapper/218:14:392
216842532,9sleep20-21swapper/221:01:262
129882533,43sleep20-21swapper/219:59:222
729299526,27cyclictest0-21swapper/322:44:263
729299525,13cyclictest0-21swapper/320:16:463
729299524,33cyclictest0-21swapper/321:16:513
7292995223,10cyclictest9873-21diskstats23:06:563
7292995221,13cyclictest0-21swapper/322:17:083
7292995221,13cyclictest0-21swapper/322:17:083
7292995221,13cyclictest0-21swapper/319:07:133
7292995219,11cyclictest10759-21gltestperf21:32:023
7292995219,11cyclictest10759-21gltestperf21:32:023
729199524,40cyclictest0-21swapper/219:17:052
7291995236,10cyclictest17911-21tail21:42:072
7291995235,10cyclictest28272-21aten_r1power_vo22:46:542
728899524,42cyclictest0-21swapper/019:57:000
728899524,30cyclictest0-21swapper/021:17:100
728899524,26cyclictest0-21swapper/019:43:340
728899524,11cyclictest0-21swapper/022:32:110
7288995236,11cyclictest0-21swapper/020:52:100
7288995236,11cyclictest0-21swapper/020:52:100
7288995235,10cyclictest10242-21grep17:47:050
7288995231,14cyclictest0-21swapper/021:12:190
7288995221,13cyclictest0-21swapper/019:31:470
7288995221,13cyclictest0-21swapper/019:31:470
7288995220,13cyclictest0-21swapper/022:02:210
248599520,5rtkit-daemon2484-21rtkit-daemon22:58:082
248599520,5rtkit-daemon2484-21rtkit-daemon22:58:082
248599520,4rtkit-daemon2484-21rtkit-daemon20:21:293
248599520,4rtkit-daemon2484-21rtkit-daemon20:16:592
729299516,28cyclictest0-21swapper/321:49:203
729299516,27cyclictest0-21swapper/320:43:243
729299515,28cyclictest0-21swapper/320:51:563
729299515,28cyclictest0-21swapper/320:51:563
729299515,28cyclictest0-21swapper/320:06:593
729299515,28cyclictest0-21swapper/320:06:593
729299515,28cyclictest0-21swapper/319:32:183
729299515,28cyclictest0-21swapper/317:42:253
729299515,27cyclictest0-21swapper/320:02:063
729299515,27cyclictest0-21swapper/319:27:083
729299515,27cyclictest0-21swapper/319:27:083
729299515,27cyclictest0-21swapper/318:46:503
729299515,26cyclictest30892-21fschecks_time22:02:003
729299515,26cyclictest0-21swapper/321:13:123
729299514,29cyclictest0-21swapper/318:27:063
729299514,28cyclictest0-21swapper/318:36:593
729299514,27cyclictest1287-21snmpd23:04:033
729299514,27cyclictest0-21swapper/322:36:563
729299514,26cyclictest0-21swapper/321:09:543
7292995133,12cyclictest14256-21hwlatdetect21:37:023
7292995120,14cyclictest0-21swapper/320:34:353
7292995119,14cyclictest0-21swapper/317:47:223
729199514,39cyclictest30071-21yum-updatesd-he20:25:262
729199514,11cyclictest0-21swapper/220:07:052
729199514,11cyclictest0-21swapper/220:07:052
728899514,9cyclictest1765-21aten_r1power_cu20:31:560
728899514,40cyclictest0-21swapper/019:47:000
728899514,28cyclictest0-21swapper/023:06:530
728899514,28cyclictest0-21swapper/021:22:040
728899514,27cyclictest0-21swapper/019:02:090
728899514,12cyclictest0-21swapper/021:42:060
728899514,12cyclictest0-21swapper/020:17:170
7288995134,10cyclictest7093-21grep18:47:100
728899513,41cyclictest0-21swapper/021:06:560
7288995120,13cyclictest0-21swapper/022:11:580
7288995115,7cyclictest19484-21ssh20:57:010
248599510,5rtkit-daemon2484-21rtkit-daemon21:05:572
729299504,29cyclictest0-21swapper/319:25:293
729299504,28cyclictest0-21swapper/319:37:143
729299504,28cyclictest0-21swapper/319:12:203
729299504,27cyclictest0-21swapper/322:22:023
729299504,27cyclictest0-21swapper/318:31:583
729299504,27cyclictest0-21swapper/317:52:103
729299504,26cyclictest0-21swapper/318:12:263
7292995019,12cyclictest15293-21taskset19:03:083
7292995018,14cyclictest0-21swapper/322:11:543
7292995018,13cyclictest0-21swapper/318:02:243
7292995018,13cyclictest0-21swapper/318:02:243
729199504,40cyclictest0-21swapper/221:52:002
729199504,40cyclictest0-21swapper/220:26:562
729199504,39cyclictest0-21swapper/221:47:072
7291995033,11cyclictest11899-21gltestperf18:57:072
729199503,41cyclictest6091-21gltestperf20:37:032
728899504,30cyclictest0-21swapper/020:41:580
728899504,28cyclictest0-21swapper/020:37:110
728899504,27cyclictest0-21swapper/020:07:060
728899504,27cyclictest0-21swapper/020:07:060
7288995034,10cyclictest32295-21wc18:32:100
7288995034,10cyclictest21281-21uname21:47:080
7288995030,14cyclictest0-21swapper/022:17:140
7288995030,14cyclictest0-21swapper/022:17:140
7288995020,12cyclictest0-21swapper/018:57:170
7288995020,12cyclictest0-21swapper/018:27:100
36042503,11sleep20-21swapper/222:09:102
248599500,5rtkit-daemon2484-21rtkit-daemon23:01:532
9872493,11sleep00-21swapper/022:52:370
729299495,26cyclictest0-21swapper/318:47:033
7292994918,13cyclictest0-21swapper/319:42:133
7292994916,13cyclictest0-21swapper/317:57:223
7291994936,8cyclictest25553-21sh21:06:572
729199493,40cyclictest0-21swapper/220:45:022
729199493,20cyclictest0-21swapper/221:38:552
729199493,20cyclictest0-21swapper/219:02:032
7291994919,12cyclictest0-21swapper/222:43:122
728899497,8cyclictest121850irq/46-eth022:37:080
728899494,27cyclictest0-21swapper/018:25:190
728899494,27cyclictest0-21swapper/018:12:230
728899494,27cyclictest0-21swapper/018:07:190
728899494,27cyclictest0-21swapper/017:52:180
7288994930,13cyclictest0-21swapper/021:31:420
728899493,40cyclictest0-21swapper/021:52:150
728899493,33cyclictest0-21swapper/019:12:000
728899493,28cyclictest0-21swapper/019:37:090
286092492,42sleep20-21swapper/218:25:032
7292994828,14cyclictest19737-21cpuspeed_turbos18:07:053
729199484,39cyclictest0-21swapper/220:03:282
729199484,38cyclictest0-21swapper/221:36:222
729199484,38cyclictest0-21swapper/221:36:222
7291994832,10cyclictest546-21grep21:17:022
7291994821,12cyclictest0-21swapper/222:02:062
728899483,27cyclictest0-21swapper/018:17:180
320562483,11sleep20-21swapper/218:32:082
310462482,9sleep20-21swapper/218:30:432
729299476,25cyclictest20650-21aten2.4-expect19:17:003
729199474,36cyclictest0-21swapper/220:51:542
729199474,36cyclictest0-21swapper/220:51:542
7291994720,12cyclictest0-21swapper/218:17:062
728899474,26cyclictest0-21swapper/019:17:110
728899474,26cyclictest0-21swapper/018:37:090
729299465,25cyclictest0-21swapper/318:57:003
7292994628,12cyclictest10368-21unixbench_multi18:52:223
7292994613,12cyclictest0-21swapper/318:16:553
729199465,35cyclictest0-21swapper/219:27:052
729199465,35cyclictest0-21swapper/219:27:052
7291994619,12cyclictest0-21swapper/217:52:072
728899466,36cyclictest0-21swapper/019:09:180
7288994633,9cyclictest4760-21cut18:42:090
729299455,24cyclictest0-21swapper/318:24:213
729199453,25cyclictest0-21swapper/217:42:262
729199453,12cyclictest0-21swapper/219:32:092
7291994529,10cyclictest15505-21grep17:57:092
7291994522,9cyclictest1287-21snmpd18:07:252
7291994518,12cyclictest0-21swapper/218:05:212
7291994518,12cyclictest0-21swapper/218:05:212
729199443,25cyclictest0-21swapper/218:42:052
7291994429,10cyclictest7480-21grep18:47:162
7291994425,13cyclictest0-21swapper/217:47:052
7291994413,18cyclictest1247-21lldpd18:41:072
728899446,32cyclictest15-21rcuc/017:42:240
178352442,9sleep20-21swapper/219:10:092
7291994328,9cyclictest19342-21wc19:12:132
108022432,9sleep20-21swapper/218:56:472
729199423,24cyclictest22981-21munin-node19:22:092
7291993922,11cyclictest0-21swapper/217:41:512
69122384,6sleep30-21swapper/317:37:253
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional