You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-28 - 06:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Sun Jun 28, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15993997444,24cyclictest0-21swapper/219:01:472
1599299716,13cyclictest0-21swapper/121:36:411
116512718,55sleep00-21swapper/023:07:070
231232703,41sleep00-21swapper/023:25:090
1598999703,61cyclictest0-21swapper/022:56:570
15989996913,38cyclictest11630-21ssh22:20:280
1599299683,11cyclictest0-21swapper/122:11:591
15989996833,13cyclictest0-21swapper/021:00:190
1599299675,12cyclictest0-21swapper/122:16:541
1599299654,10cyclictest0-21swapper/120:31:571
1598999655,50cyclictest0-21swapper/018:42:180
1598999654,11cyclictest0-21swapper/022:12:060
15993996446,12cyclictest0-21swapper/200:02:072
1599399644,53cyclictest0-21swapper/221:55:252
1599399644,53cyclictest0-21swapper/221:55:252
1598999647,51cyclictest24288-21sendmail_mailtr21:02:110
1598999645,51cyclictest0-21swapper/019:51:570
1598999645,51cyclictest0-21swapper/019:51:570
15989996436,12cyclictest0-21swapper/022:51:500
38092633,53sleep13961-21cat21:21:431
165492632,52sleep00-21swapper/023:15:500
15993996337,13cyclictest0-21swapper/221:46:412
1599299637,13cyclictest0-21swapper/100:01:291
1599299637,13cyclictest0-21swapper/100:01:291
1599299633,53cyclictest0-21swapper/121:27:051
1599299633,12cyclictest0-21swapper/123:37:211
1598999634,51cyclictest0-21swapper/021:42:150
15989996335,13cyclictest0-21swapper/023:56:550
15989996335,13cyclictest0-21swapper/023:56:550
15989996333,13cyclictest0-21swapper/023:52:000
1598999633,53cyclictest0-21swapper/022:01:550
15994996211,44cyclictest0-21swapper/322:11:403
15993996244,13cyclictest0-21swapper/200:01:282
15993996244,13cyclictest0-21swapper/200:01:282
15993996244,12cyclictest0-21swapper/222:07:182
15993996242,14cyclictest0-21swapper/219:17:032
1599399624,52cyclictest0-21swapper/222:01:502
15993996238,11cyclictest0-21swapper/223:27:012
15993996237,12cyclictest0-21swapper/221:27:122
15989996232,14cyclictest0-21swapper/022:41:530
15989996232,13cyclictest0-21swapper/023:21:160
15989996232,13cyclictest0-21swapper/023:21:160
1598999623,50cyclictest0-21swapper/022:36:390
1598999623,14cyclictest8726-21diskmemload21:27:140
219499610,8rtkit-daemon2193-21rtkit-daemon22:46:500
1599499614,50cyclictest0-21swapper/320:55:063
15993996144,12cyclictest0-21swapper/222:46:522
1599399614,51cyclictest0-21swapper/222:56:192
15993996138,11cyclictest0-21swapper/222:32:032
15993996136,12cyclictest0-21swapper/200:07:052
15993996135,13cyclictest0-21swapper/220:48:332
15993996134,13cyclictest0-21swapper/222:11:542
1598999613,41cyclictest0-21swapper/023:02:000
1598999613,13cyclictest0-21swapper/023:31:580
1598999612,9cyclictest25559-21taskset21:52:060
1598999612,9cyclictest25559-21taskset21:52:060
125152614,11sleep00-21swapper/020:46:590
191892604,12sleep10-21swapper/123:18:081
191892604,12sleep10-21swapper/123:18:081
182262603,50sleep10-21swapper/122:29:591
15994996013,38cyclictest0-21swapper/321:56:533
15993996043,12cyclictest0-21swapper/223:09:392
1599399604,50cyclictest0-21swapper/223:12:012
15993996039,12cyclictest0-21swapper/223:32:012
15993996037,7cyclictest27170-21ssh21:07:032
15993996036,11cyclictest0-21swapper/223:19:002
15993996036,11cyclictest0-21swapper/223:19:002
15993996036,11cyclictest0-21swapper/223:01:492
15993996036,11cyclictest0-21swapper/220:52:472
15993996035,9cyclictest1227-21runrttasks23:47:092
15993996035,12cyclictest0-21swapper/219:12:002
1599299605,11cyclictest0-21swapper/121:04:021
1599299604,49cyclictest0-21swapper/120:52:011
1599299604,12cyclictest0-21swapper/123:51:481
15989996033,13cyclictest0-21swapper/021:46:560
15989996033,12cyclictest0-21swapper/021:35:430
15989996032,13cyclictest0-21swapper/023:27:570
15989996031,13cyclictest0-21swapper/021:17:040
15989996031,13cyclictest0-21swapper/000:06:520
15989996031,12cyclictest0-21swapper/023:41:370
3127525910,42sleep10-21swapper/122:48:211
1599399595,39cyclictest0-21swapper/222:42:522
15993995943,11cyclictest0-21swapper/222:16:572
15993995943,11cyclictest0-21swapper/221:38:472
15993995942,12cyclictest0-21swapper/222:27:242
15993995940,14cyclictest0-21swapper/221:23:442
15993995934,12cyclictest0-21swapper/221:19:442
15993995933,13cyclictest0-21swapper/222:36:502
1599299595,47cyclictest0-21swapper/122:32:141
1599299594,48cyclictest0-21swapper/123:11:551
1599299594,48cyclictest0-21swapper/121:52:051
1599299594,48cyclictest0-21swapper/121:52:051
1599299594,48cyclictest0-21swapper/120:18:341
1599299593,51cyclictest0-21swapper/123:45:491
1599299593,50cyclictest0-21swapper/123:33:491
15989995932,13cyclictest0-21swapper/021:22:560
15989995932,12cyclictest0-21swapper/021:37:300
15989995931,13cyclictest0-21swapper/023:47:060
15989995931,13cyclictest0-21swapper/022:40:120
15989995931,13cyclictest0-21swapper/020:12:050
37882583,48sleep30-21swapper/323:43:103
327182584,46sleep10-21swapper/121:16:431
327182584,46sleep10-21swapper/121:16:431
15993995837,12cyclictest0-21swapper/223:36:572
15993995835,8cyclictest11599-21munin-node21:32:012
15993995833,12cyclictest0-21swapper/223:51:582
15993995833,12cyclictest0-21swapper/220:59:512
1599299585,47cyclictest32507-21ssh22:02:081
1599299584,48cyclictest0-21swapper/123:22:401
1599299584,47cyclictest0-21swapper/122:23:151
1599299584,47cyclictest0-21swapper/120:28:361
1599299584,47cyclictest0-21swapper/119:57:151
1599299584,46cyclictest0-21swapper/118:52:021
1599299583,12cyclictest0-21swapper/122:36:551
15992995824,28cyclictest3545-21munin-node22:57:001
1598999583,12cyclictest0-21swapper/018:57:010
15989995829,13cyclictest0-21swapper/023:44:550
219499570,6rtkit-daemon2193-21rtkit-daemon22:23:050
15993995740,12cyclictest0-21swapper/222:24:342
15993995739,13cyclictest0-21swapper/221:58:312
15993995735,7cyclictest20512-21ssh23:21:492
15993995733,11cyclictest0-21swapper/219:42:112
15993995726,14cyclictest0-21swapper/221:49:202
1599299575,45cyclictest0-21swapper/119:12:111
1599299574,47cyclictest0-21swapper/121:38:241
1599299574,46cyclictest6988-21kworker/1:223:28:311
1599299574,46cyclictest0-21swapper/123:06:501
1599299574,46cyclictest0-21swapper/122:51:571
1599299574,46cyclictest0-21swapper/122:41:551
1599299574,46cyclictest0-21swapper/121:56:461
1599299574,46cyclictest0-21swapper/120:57:011
1598999574,47cyclictest0-21swapper/022:07:020
15989995731,12cyclictest0-21swapper/021:57:100
1598999573,9cyclictest32220-21ssh21:14:570
1598999573,9cyclictest32220-21ssh21:14:570
1598999573,9cyclictest11690-21ssh20:45:490
15994995634,8cyclictest1698-21kworker/3:123:58:593
15994995634,8cyclictest1698-21kworker/3:123:58:593
15994995632,9cyclictest8726-21diskmemload23:46:593
1599399568,30cyclictest0-21swapper/221:12:052
1599399568,30cyclictest0-21swapper/221:12:052
15993995629,13cyclictest0-21swapper/222:56:582
1599299565,45cyclictest0-21swapper/122:06:561
1599299564,46cyclictest0-21swapper/100:07:071
1599299564,46cyclictest0-21swapper/100:03:471
15992995619,13cyclictest0-21swapper/121:47:081
15989995630,12cyclictest0-21swapper/000:02:420
1598999563,47cyclictest0-21swapper/021:08:390
15989995628,13cyclictest0-21swapper/020:56:290
252012554,44sleep20-21swapper/221:04:062
219499550,5rtkit-daemon2193-21rtkit-daemon22:26:580
1599499554,23cyclictest0-21swapper/322:33:333
15994995515,25cyclictest107550irq/46-eth021:52:103
15994995515,25cyclictest107550irq/46-eth021:52:103
15993995540,11cyclictest0-21swapper/220:21:122
15993995532,8cyclictest883-21unixbench-2d20:22:152
15993995532,8cyclictest10338-21proc_pri20:42:122
15993995530,11cyclictest0-21swapper/223:43:302
15993995529,13cyclictest0-21swapper/219:22:092
15993995529,11cyclictest0-21swapper/218:47:032
15993995528,12cyclictest0-21swapper/218:52:062
1599299554,46cyclictest0-21swapper/121:23:231
1599299554,45cyclictest0-21swapper/123:49:211
1599299554,45cyclictest0-21swapper/118:51:111
1599299554,44cyclictest9361-21cstates20:41:571
1599299554,27cyclictest0-21swapper/119:22:171
1599299552,31cyclictest0-21swapper/120:48:391
1598999553,36cyclictest0-21swapper/020:21:400
1599499544,43cyclictest0-21swapper/322:21:393
1599499544,35cyclictest0-21swapper/322:39:383
15994995434,7cyclictest8726-21diskmemload21:09:393
1599399544,43cyclictest0-21swapper/219:36:472
15993995437,12cyclictest0-21swapper/219:28:092
15993995433,6cyclictest0-21swapper/219:07:002
15993995433,6cyclictest0-21swapper/219:07:002
1599399543,46cyclictest0-21swapper/219:51:462
15993995429,11cyclictest0-21swapper/220:27:042
1599299545,43cyclictest0-21swapper/121:42:271
1599299545,42cyclictest16093-21memory19:47:101
1599299543,46cyclictest0-21swapper/121:08:101
1598999545,10cyclictest0-21swapper/019:41:090
15989995431,10cyclictest0-21swapper/019:06:590
15989995431,10cyclictest0-21swapper/019:06:590
15989995424,13cyclictest0-21swapper/020:31:440
1598999542,6cyclictest27402-21unixbench-2d19:02:180
15994995334,7cyclictest1124-21snmpd23:39:083
15994995334,13cyclictest0-21swapper/300:08:283
15994995324,8cyclictest3660-21ssh22:56:503
15993995337,12cyclictest0-21swapper/220:38:472
15993995329,11cyclictest0-21swapper/218:42:102
1599299534,30cyclictest0-21swapper/120:12:091
1599299534,27cyclictest0-21swapper/118:43:181
1599299533,44cyclictest0-21swapper/123:02:261
1598999534,44cyclictest0-21swapper/019:13:120
1598999534,43cyclictest0-21swapper/020:38:170
15989995329,11cyclictest0-21swapper/019:34:200
15989995328,11cyclictest0-21swapper/019:56:510
73492522,9sleep00-21swapper/019:29:120
192332524,9sleep30-21swapper/319:53:173
192332524,9sleep30-21swapper/319:53:173
15994995233,7cyclictest8726-21diskmemload22:24:083
15994995233,7cyclictest25906-21ssh23:28:023
15994995232,8cyclictest1124-21snmpd19:43:293
15994995225,15cyclictest20139-21ssh23:21:333
15994995225,15cyclictest20139-21ssh23:21:333
15994995225,12cyclictest0-21swapper/321:42:033
15994995224,9cyclictest7148-21ssh23:01:513
15993995223,13cyclictest0-21swapper/219:56:592
15993995221,14cyclictest0-21swapper/220:07:062
1599299524,29cyclictest0-21swapper/119:27:161
1599299523,27cyclictest0-21swapper/120:01:561
1598999524,33cyclictest0-21swapper/020:31:540
15989995229,12cyclictest0-21swapper/019:23:000
15989995228,11cyclictest0-21swapper/019:17:180
244522512,7sleep124535-21cat18:57:131
15994995132,7cyclictest20643-21kworker/3:221:50:383
15994995131,8cyclictest6532-21runrttasks21:24:193
15994995130,15cyclictest0-21swapper/318:52:003
1599299513,43cyclictest8411-21fschecks_count19:32:021
1598999514,28cyclictest0-21swapper/020:02:030
15989995129,10cyclictest0-21swapper/019:47:130
15989995128,11cyclictest0-21swapper/018:47:000
266402502,42sleep00-21swapper/020:11:360
1599499505,12cyclictest0-21swapper/322:52:023
1599499504,39cyclictest0-21swapper/320:48:533
15994995032,7cyclictest8726-21diskmemload21:17:113
15994995031,7cyclictest20643-21kworker/3:222:03:553
15994995031,7cyclictest17381-21ssh00:03:303
15994995027,9cyclictest6651-21memory22:12:043
15994995027,8cyclictest8561-21latency21:27:053
15994995025,7cyclictest2956-21cat19:21:483
15994995024,12cyclictest0-21swapper/323:33:423
15993995026,11cyclictest0-21swapper/219:36:572
15993995023,12cyclictest0-21swapper/219:56:462
15993995023,12cyclictest0-21swapper/219:56:462
15989995028,11cyclictest0-21swapper/020:21:550
15994994930,7cyclictest8346-21ssh23:51:393
15994994929,8cyclictest22991-21ssh23:24:403
15994994929,8cyclictest14604-21which23:11:573
15993994927,9cyclictest0-21swapper/220:12:072
15993994927,10cyclictest0-21swapper/220:01:572
15993994921,13cyclictest0-21swapper/220:32:002
15989994927,10cyclictest0-21swapper/018:54:230
116352493,39sleep311639-21swap19:37:173
15994994830,7cyclictest19898-21telnet19:56:573
1599499483,33cyclictest0-21swapper/321:40:203
15994994829,7cyclictest30548-21ssh22:47:073
15994994825,7cyclictest20881-21cat18:51:483
15994994824,18cyclictest17895-21unixbench_multi18:42:233
15994994822,9cyclictest107550irq/46-eth022:26:563
1599399484,27cyclictest0-21swapper/219:03:222
1599299485,12cyclictest0-21swapper/119:41:451
15992994833,9cyclictest32009-21tr20:21:561
1599299483,27cyclictest0-21swapper/119:16:591
98042472,9sleep30-21swapper/319:34:513
85102473,9sleep10-21swapper/120:39:061
318582473,6sleep331859-21sh21:13:393
318582473,6sleep331859-21sh21:13:393
266162473,38sleep10-21swapper/120:11:171
1599499474,27cyclictest0-21swapper/321:06:293
15994994726,9cyclictest4284-21telnet20:31:553
1599499472,29cyclictest0-21swapper/320:27:173
1599299477,36cyclictest0-21swapper/119:02:181
146532472,39sleep00-21swapper/019:45:530
112032472,37sleep30-21swapper/321:31:573
325652462,9sleep30-21swapper/320:22:033
264982462,38sleep30-21swapper/320:09:463
15994994627,13cyclictest0-21swapper/323:07:003
15994994618,12cyclictest0-21swapper/319:22:523
15994994610,8cyclictest26901-21missed_timers22:42:033
1599299464,11cyclictest0-21swapper/119:41:561
1599299463,11cyclictest0-21swapper/119:07:071
1599299463,11cyclictest0-21swapper/119:07:071
1599499454,35cyclictest0-21swapper/320:21:163
1599499454,34cyclictest0-21swapper/319:27:033
1599499454,11cyclictest0-21swapper/320:41:553
15994994530,9cyclictest27493-21unixbench_singl19:02:183
1599499453,35cyclictest23361-21munin-node18:57:153
15994994522,10cyclictest0-21swapper/320:56:563
1599399453,34cyclictest15965-21latency_hist18:41:492
1599299454,12cyclictest0-21swapper/118:41:491
241982442,9sleep30-21swapper/320:05:513
1599499445,32cyclictest6784-21cpu20:36:573
15994994429,9cyclictest28492-21cpuspeed_turbos19:07:013
15994994429,9cyclictest28492-21cpuspeed_turbos19:07:013
15994994428,10cyclictest16692-21unixbench_multi19:47:193
15994994422,8cyclictest107550irq/46-eth019:12:093
1599299443,10cyclictest0-21swapper/119:52:131
1599299443,10cyclictest0-21swapper/119:52:131
156902444,34sleep00-21swapper/018:38:220
1599499434,33cyclictest0-21swapper/320:12:093
15994994317,9cyclictest15965-21latency_hist18:41:493
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional