You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-01 - 10:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Sat Aug 01, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
674921400,10sleep32560399cyclictest18:35:173
256029910741,10cyclictest14029-21rm20:50:092
1817321040,8sleep118175-21grep22:35:001
2560399954,39cyclictest0-21swapper/321:52:223
2560399954,39cyclictest0-21swapper/321:52:223
25603999321,12cyclictest0-21swapper/320:45:183
2560399913,21cyclictest0-21swapper/320:34:523
25603998927,13cyclictest0-21swapper/322:10:003
25603998720,13cyclictest0-21swapper/321:28:353
25603998719,13cyclictest0-21swapper/321:35:153
25603998637,7cyclictest29211-21rm22:51:063
25603998634,10cyclictest17057-21gltestperf20:55:043
25603998624,10cyclictest0-21swapper/323:06:043
2560399855,37cyclictest0-21swapper/321:40:133
2560399834,22cyclictest0-21swapper/322:41:383
25603998319,14cyclictest0-21swapper/323:36:593
25603998233,7cyclictest18966-21ssh21:46:383
25603998220,12cyclictest0-21swapper/318:09:503
25603998119,12cyclictest0-21swapper/318:40:073
25603998030,7cyclictest29019-21rm21:14:343
25603998030,7cyclictest29019-21rm21:14:343
2560399803,35cyclictest0-21swapper/322:24:403
25603998022,10cyclictest1227-21runrttasks22:05:473
25603998019,12cyclictest0-21swapper/322:19:043
25603998015,8cyclictest19516-21cpu23:29:503
25603997929,7cyclictest8705-21ssh23:12:383
25603997929,7cyclictest8705-21ssh23:12:383
25603997926,7cyclictest19462-21rm22:36:253
25603997830,8cyclictest1718-21munin-node19:35:133
25603997828,9cyclictest5236-21latency_hist18:34:503
25603997824,7cyclictest25472-21ssh22:45:123
25603997727,7cyclictest32105-21ssh22:55:133
25603997627,8cyclictest31689-21kworker/3:221:15:553
25603997621,12cyclictest0-21swapper/320:19:583
2560099754,63cyclictest0-21swapper/122:59:551
2560399744,14cyclictest0-21swapper/322:04:143
25603997427,7cyclictest26300-21ssh21:59:353
25603997329,7cyclictest16017-21ssh23:24:393
25603997328,7cyclictest16270-21ssh22:31:463
25603997328,7cyclictest16270-21ssh22:31:463
25603997327,7cyclictest30697-21ssh20:26:143
25603997327,7cyclictest30697-21ssh20:26:143
25603997327,13cyclictest0-21swapper/323:04:363
57702720,5sleep25772-21cpuspeed_turbos18:35:032
25603997228,7cyclictest9473-21rm21:32:593
25603997128,7cyclictest25171-21ssh21:07:213
2560399703,14cyclictest0-21swapper/320:33:563
25603997026,7cyclictest12378-21kworker/3:019:05:013
25603997026,7cyclictest12378-21kworker/3:019:05:013
25603997025,7cyclictest11824-21ssh23:17:003
2559599703,59cyclictest9006-21aten_r1power_cu19:49:570
25602996742,11cyclictest0-21swapper/221:34:552
2560299674,12cyclictest12505-21crond23:19:382
2560299664,55cyclictest0-21swapper/223:09:382
2560099663,30cyclictest0-21swapper/122:31:371
2560099663,30cyclictest0-21swapper/122:31:371
25600996618,23cyclictest1680-21sendmail_mailqu21:20:121
2560299656,52cyclictest1227-21runrttasks19:50:152
2560299654,15cyclictest0-21swapper/223:10:072
2560299654,15cyclictest0-21swapper/223:10:072
2560299654,14cyclictest0-21swapper/222:35:122
25602996538,12cyclictest0-21swapper/220:14:452
2560299653,54cyclictest0-21swapper/222:54:552
25602996439,12cyclictest0-21swapper/220:25:292
25602996439,12cyclictest0-21swapper/220:25:292
25602996438,13cyclictest0-21swapper/223:21:222
25602996437,11cyclictest0-21swapper/221:39:532
25602996437,10cyclictest30827-21mailstats21:15:152
25602996436,13cyclictest0-21swapper/221:30:012
25600996417,40cyclictest13795-21tr21:39:551
2559599644,53cyclictest0-21swapper/021:44:520
2559599644,53cyclictest0-21swapper/021:14:570
25602996340,9cyclictest11282-21wc20:45:172
2560299634,53cyclictest0-21swapper/218:45:022
25602996339,8cyclictest15936-21crond20:59:382
25602996339,11cyclictest0-21swapper/220:20:062
25602996336,12cyclictest0-21swapper/223:04:362
2560299633,54cyclictest0-21swapper/222:29:592
2560299633,54cyclictest0-21swapper/222:29:592
25600996317,13cyclictest0-21swapper/122:21:081
2559599634,52cyclictest0-21swapper/021:00:050
2560299625,50cyclictest0-21swapper/222:04:562
25602996236,11cyclictest0-21swapper/222:20:002
25602996235,13cyclictest0-21swapper/221:20:032
25602996235,12cyclictest0-21swapper/222:14:502
25602996234,12cyclictest0-21swapper/222:25:082
25602996234,10cyclictest0-21swapper/221:47:422
2560299623,54cyclictest0-21swapper/218:40:542
25602996229,11cyclictest0-21swapper/221:25:502
2560099625,51cyclictest0-21swapper/121:38:381
232822623,51sleep00-21swapper/021:54:490
2560299615,50cyclictest0-21swapper/222:48:492
2560299615,50cyclictest0-21swapper/218:20:022
25602996142,11cyclictest0-21swapper/223:35:052
25602996136,9cyclictest17398-21munin-node19:00:282
25602996135,12cyclictest0-21swapper/220:40:002
25602996135,11cyclictest0-21swapper/219:30:092
25602996134,12cyclictest0-21swapper/222:50:342
2560299613,53cyclictest0-21swapper/220:14:582
2560299613,52cyclictest0-21swapper/223:30:002
2560299613,52cyclictest0-21swapper/221:05:162
2560299612,52cyclictest0-21swapper/221:09:542
2560299612,52cyclictest0-21swapper/221:09:542
2560099615,42cyclictest0-21swapper/120:51:111
25595996133,9cyclictest18939-21ssh22:35:130
25595996128,14cyclictest0-21swapper/020:29:560
251652613,51sleep10-21swapper/119:15:061
276232606,7sleep20-21swapper/218:10:252
2560299604,50cyclictest0-21swapper/218:50:232
2560299604,49cyclictest0-21swapper/221:55:142
25602996038,7cyclictest20375-21ssh21:49:562
25602996038,7cyclictest20375-21ssh21:49:562
25602996035,11cyclictest0-21swapper/223:25:372
25602996032,9cyclictest0-21swapper/221:00:132
25602996032,14cyclictest0-21swapper/222:43:002
25602996030,11cyclictest0-21swapper/222:13:562
2560299603,51cyclictest0-21swapper/221:59:572
2560099605,49cyclictest0-21swapper/122:10:051
2560099604,14cyclictest0-21swapper/122:03:081
2560099604,13cyclictest0-21swapper/122:40:481
2560099603,13cyclictest0-21swapper/122:16:401
25600996021,14cyclictest0-21swapper/119:20:071
25600996017,12cyclictest0-21swapper/121:30:431
25600996017,10cyclictest18134-21munin-node21:45:081
25600996015,13cyclictest0-21swapper/122:45:211
25595996038,6cyclictest24363-21ssh21:05:160
25595996036,9cyclictest27105-21ssh21:10:050
25595996036,9cyclictest27105-21ssh21:10:050
25595996036,8cyclictest21879-21ssh21:50:170
25595996036,8cyclictest21879-21ssh21:50:170
2559599603,50cyclictest30425-21ssh22:54:510
262502593,11sleep00-21swapper/022:47:210
25602995934,9cyclictest3999-21sed20:35:042
25602995933,11cyclictest0-21swapper/220:31:042
2560099598,8cyclictest0-21swapper/122:06:041
2560099596,31cyclictest0-21swapper/121:13:241
2560099596,31cyclictest0-21swapper/121:13:241
2560099596,11cyclictest22605-21perl20:15:061
2560099595,25cyclictest0-21swapper/122:57:411
2560099595,10cyclictest17564-21smartctl23:25:101
2560099594,24cyclictest0-21swapper/120:58:221
2560099594,23cyclictest0-21swapper/121:25:231
2560099594,14cyclictest0-21swapper/120:31:551
2560099593,26cyclictest0-21swapper/123:30:061
25600995917,13cyclictest0-21swapper/123:16:381
25600995917,12cyclictest0-21swapper/120:35:571
25600995916,14cyclictest0-21swapper/120:42:301
25595995934,8cyclictest15180-21ssh22:30:050
25595995934,8cyclictest15180-21ssh22:30:050
25595995932,9cyclictest1546-21ssh21:20:110
2559599593,51cyclictest0-21swapper/020:21:420
2559599593,50cyclictest0-21swapper/022:50:290
2559599593,11cyclictest0-21swapper/021:39:070
25595995929,12cyclictest0-21swapper/023:04:110
25595995928,13cyclictest0-21swapper/022:04:560
2560299584,48cyclictest0-21swapper/218:55:092
2560099589,11cyclictest0-21swapper/120:48:061
2560099585,46cyclictest29890-21ntp_states20:25:121
2560099585,46cyclictest29890-21ntp_states20:25:121
2560099585,25cyclictest0-21swapper/122:27:251
2560099585,25cyclictest0-21swapper/120:20:221
2560099585,23cyclictest0-21swapper/123:05:401
2560099585,22cyclictest0-21swapper/121:14:491
2560099584,27cyclictest0-21swapper/123:36:391
2560099584,26cyclictest0-21swapper/123:21:581
2560099584,25cyclictest29124-21hwlatdetect18:15:101
2560099584,23cyclictest0-21swapper/123:10:091
2560099584,23cyclictest0-21swapper/123:10:091
2560099584,23cyclictest0-21swapper/121:03:541
2560099583,26cyclictest0-21swapper/121:04:491
25600995818,11cyclictest0-21swapper/121:56:411
25600995817,13cyclictest0-21swapper/119:31:171
25600995816,13cyclictest0-21swapper/118:25:071
25600995816,13cyclictest0-21swapper/118:25:071
25600995815,16cyclictest0-21swapper/121:49:571
25600995815,16cyclictest0-21swapper/121:49:571
25600995815,13cyclictest0-21swapper/119:06:131
25600995815,13cyclictest0-21swapper/119:06:131
25600995814,15cyclictest0-21swapper/122:51:551
2559599584,14cyclictest0-21swapper/020:50:400
25595995835,7cyclictest18335-21diskmemload20:44:580
25595995832,10cyclictest20987-21timerandwakeup23:30:110
2559599583,50cyclictest0-21swapper/023:38:440
2559599583,50cyclictest0-21swapper/023:28:180
25595995827,14cyclictest0-21swapper/021:39:580
25602995734,9cyclictest0-21swapper/219:40:202
25602995732,11cyclictest0-21swapper/218:25:182
25602995732,11cyclictest0-21swapper/218:25:182
2560299573,47cyclictest6706-21aten2.4-expect19:44:592
2560299573,47cyclictest6706-21aten2.4-expect19:44:592
2560299572,50cyclictest0-21swapper/219:20:122
2560099575,25cyclictest0-21swapper/119:45:131
2560099575,25cyclictest0-21swapper/119:45:131
25600995722,12cyclictest0-21swapper/118:30:191
25600995717,12cyclictest0-21swapper/120:12:441
25600995717,12cyclictest0-21swapper/118:40:131
25595995735,9cyclictest15010-21munin-node18:54:590
25595995732,10cyclictest14458-21fschecks_time20:00:040
2559599573,47cyclictest0-21swapper/022:03:490
2559599573,47cyclictest0-21swapper/019:55:160
2559599573,12cyclictest0-21swapper/020:55:000
25603995632,18cyclictest18335-21diskmemload20:40:373
25602995625,12cyclictest0-21swapper/219:56:212
25602995621,12cyclictest0-21swapper/219:36:182
2560099564,28cyclictest0-21swapper/119:40:001
2560099564,24cyclictest0-21swapper/118:50:091
2560099564,23cyclictest0-21swapper/119:35:161
2560099563,26cyclictest0-21swapper/119:25:151
2560099563,25cyclictest12511-21memory19:55:101
25595995634,7cyclictest18335-21diskmemload22:24:090
25595995633,8cyclictest5929-21rm21:26:580
25595995633,8cyclictest1124-21snmpd18:26:060
25595995633,8cyclictest1124-21snmpd18:26:060
25595995632,9cyclictest12855-21telnet23:19:530
25595995631,10cyclictest20322-21grep20:10:190
25595995626,13cyclictest0-21swapper/023:15:010
25595995625,13cyclictest0-21swapper/023:12:210
25595995625,13cyclictest0-21swapper/023:12:210
25595995625,13cyclictest0-21swapper/020:05:030
32972553,7sleep03427-21tr20:34:580
25602995532,9cyclictest0-21swapper/220:00:182
25602995525,11cyclictest0-21swapper/219:15:212
2560099555,27cyclictest0-21swapper/118:20:141
2560099554,27cyclictest0-21swapper/119:50:191
2560099554,26cyclictest0-21swapper/119:00:161
2560099554,26cyclictest0-21swapper/118:10:131
2560099553,23cyclictest0-21swapper/118:55:061
2559599554,29cyclictest0-21swapper/018:15:040
2559599553,45cyclictest0-21swapper/023:04:420
2559599553,45cyclictest0-21swapper/019:00:010
25595995516,24cyclictest107550irq/46-eth022:40:000
17652553,45sleep00-21swapper/019:35:000
2560299544,28cyclictest0-21swapper/219:05:092
2560299544,28cyclictest0-21swapper/219:05:092
2560299544,27cyclictest0-21swapper/219:25:212
2560299543,29cyclictest0-21swapper/220:05:132
25602995429,10cyclictest0-21swapper/218:15:182
25602995414,15cyclictest0-21swapper/218:30:172
2559599544,43cyclictest18335-21diskmemload22:24:480
2559599543,45cyclictest0-21swapper/022:15:010
2559599543,45cyclictest0-21swapper/022:13:140
2559599543,44cyclictest0-21swapper/020:26:540
2559599543,44cyclictest0-21swapper/020:26:540
25595995421,13cyclictest0-21swapper/020:16:530
205112542,45sleep00-21swapper/019:05:090
205112542,45sleep00-21swapper/019:05:090
293812536,11sleep00-21swapper/019:25:000
25603995339,8cyclictest14487-21sshd18:51:053
2560299534,12cyclictest0-21swapper/219:10:162
2560099534,26cyclictest0-21swapper/118:46:101
2560099534,26cyclictest0-21swapper/118:35:101
2559599534,32cyclictest0-21swapper/018:50:130
2559599533,44cyclictest0-21swapper/020:39:490
25595995315,23cyclictest0-21swapper/018:20:150
2559599523,43cyclictest0-21swapper/019:46:190
2559599523,43cyclictest0-21swapper/019:46:190
2559599523,42cyclictest0-21swapper/019:10:060
25595995222,13cyclictest0-21swapper/018:45:010
25595995221,13cyclictest0-21swapper/021:30:080
246712524,39sleep00-21swapper/018:05:170
2559599513,24cyclictest0-21swapper/019:21:470
25603995029,8cyclictest32613-21munin-node21:20:073
2559599503,41cyclictest0-21swapper/019:41:180
25595995023,12cyclictest0-21swapper/018:39:490
25595995023,11cyclictest0-21swapper/018:30:150
2560399493,40cyclictest0-21swapper/323:22:363
2560399493,39cyclictest0-21swapper/320:05:003
25603994921,13cyclictest0-21swapper/321:03:513
2559599493,40cyclictest0-21swapper/018:10:010
251472492,41sleep00-21swapper/019:15:050
25603994830,6cyclictest12970-21ssh22:26:413
25603994829,7cyclictest21158-21rm20:13:313
25603994828,8cyclictest1124-21snmpd19:21:103
25603994822,10cyclictest8980-21cat19:49:473
2559599483,40cyclictest0-21swapper/018:40:000
14642482,40sleep00-21swapper/019:34:440
25603994733,8cyclictest15761-21perl18:55:063
25603994733,8cyclictest10239-21munin-node18:45:103
25603994728,7cyclictest24445-21ssh20:18:013
25603994630,10cyclictest5101-21gltestperf19:40:063
25603994630,10cyclictest2355-21unixbench-2d18:25:233
25603994630,10cyclictest2355-21unixbench-2d18:25:233
25603994620,12cyclictest0-21swapper/320:50:003
25600994618,12cyclictest0-21swapper/120:05:141
147852463,37sleep114795-21iostat_ios20:00:081
2560399454,34cyclictest0-21swapper/319:29:473
25603994530,9cyclictest31397-21gltestperf18:20:103
25603994526,7cyclictest32718-21if_eth019:30:083
2560099453,25cyclictest0-21swapper/119:10:211
25600994515,12cyclictest0-21swapper/118:09:501
253162454,6sleep20-21swapper/218:06:352
2560399444,32cyclictest0-21swapper/319:59:463
25603994419,10cyclictest14511-21fschecks_time20:00:043
85552432,35sleep30-21swapper/319:47:083
25603994330,8cyclictest24883-21cpuspeed_turbos19:15:013
2560399433,13cyclictest0-21swapper/319:00:123
25603994329,9cyclictest18687-21kworker/3:118:15:013
25603994228,9cyclictest26685-21gltestperf18:10:093
2560399422,24cyclictest0-21swapper/319:10:053
111212422,34sleep30-21swapper/319:54:263
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional