You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-11 - 19:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sat Apr 11, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2010921090,6sleep320110-21cat10:37:573
80832910,3sleep012-21rcu_preempt05:58:110
311112770,10sleep12076199cyclictest07:42:591
2076299682,59cyclictest0-21swapper/208:05:022
2076299673,57cyclictest0-21swapper/208:02:292
20763996645,14cyclictest0-21swapper/309:46:083
2076399662,57cyclictest11936-21ssh08:02:293
2076399653,56cyclictest13486-21diskmemload09:18:023
2076299652,57cyclictest0-21swapper/207:21:192
2075799656,14cyclictest0-21swapper/007:33:020
2075799654,53cyclictest0-21swapper/005:48:220
2075799654,53cyclictest0-21swapper/005:48:220
2076299642,56cyclictest0-21swapper/210:21:462
2076299642,56cyclictest0-21swapper/209:15:342
2075799648,33cyclictest0-21swapper/010:02:200
2075799645,51cyclictest0-21swapper/007:38:060
2075799644,41cyclictest0-21swapper/008:05:070
2075799643,55cyclictest0-21swapper/010:47:070
275392630,14sleep12076199cyclictest08:23:231
2076399633,52cyclictest1128-21crond09:12:473
2076399633,52cyclictest1128-21crond09:12:473
20762996346,11cyclictest0-21swapper/207:38:232
2076299633,54cyclictest0-21swapper/208:09:342
2076299632,55cyclictest0-21swapper/205:28:072
2075799635,50cyclictest0-21swapper/008:53:070
2075799635,50cyclictest0-21swapper/007:23:540
2075799635,50cyclictest0-21swapper/006:58:090
2075799635,50cyclictest0-21swapper/005:28:160
2075799634,51cyclictest0-21swapper/010:18:070
2075799634,51cyclictest0-21swapper/007:43:040
20757996314,42cyclictest41ktimersoftd/007:53:020
20763996243,13cyclictest0-21swapper/308:58:083
20763996243,13cyclictest0-21swapper/307:44:323
2076399622,54cyclictest0-21swapper/309:16:043
2076299624,41cyclictest211722df07:28:082
2076299623,53cyclictest21581-21ssh09:52:462
2076299623,53cyclictest21581-21ssh09:52:462
20761996250,7cyclictest13486-21diskmemload09:41:481
2075799625,51cyclictest0-21swapper/008:44:310
2075799625,50cyclictest0-21swapper/010:03:080
2075799625,49cyclictest0-21swapper/010:37:540
2075799624,50cyclictest0-21swapper/008:38:190
20763996144,11cyclictest0-21swapper/307:29:163
20763996143,12cyclictest0-21swapper/307:37:173
20763996142,13cyclictest0-21swapper/307:48:093
2076399613,53cyclictest0-21swapper/308:09:283
2076399612,53cyclictest0-21swapper/309:57:363
2076299614,51cyclictest24406-21rm09:08:062
2076299614,51cyclictest24406-21rm09:08:062
2076299613,52cyclictest20082-21ssh09:02:342
2076299612,54cyclictest0-21swapper/207:25:132
2075799615,48cyclictest0-21swapper/009:42:570
2075799614,50cyclictest0-21swapper/008:08:110
2075799614,38cyclictest0-21swapper/007:22:090
2075799614,27cyclictest0-21swapper/008:32:450
2075799614,27cyclictest0-21swapper/008:32:450
2075799613,33cyclictest0-21swapper/006:30:010
2075799613,33cyclictest0-21swapper/006:30:010
62282603,49sleep10-21swapper/109:28:141
20763996041,13cyclictest0-21swapper/306:13:083
2076399602,52cyclictest0-21swapper/308:18:493
20762996046,8cyclictest13457-21ssh10:28:002
20762996046,8cyclictest13457-21ssh10:28:002
20761996021,6cyclictest13486-21diskmemload07:36:441
2075799606,46cyclictest0-21swapper/010:34:310
2075799605,17cyclictest0-21swapper/010:11:030
2075799604,48cyclictest25701-21ssh09:08:260
2075799604,48cyclictest25701-21ssh09:08:260
2075799604,48cyclictest0-21swapper/009:12:560
2075799604,48cyclictest0-21swapper/008:48:060
2075799604,27cyclictest5789-21tune2fs09:28:070
2075799604,27cyclictest0-21swapper/009:18:190
2075799604,27cyclictest0-21swapper/006:04:490
2075799604,25cyclictest0-21swapper/008:34:310
2075799604,25cyclictest0-21swapper/008:23:000
2075799604,25cyclictest0-21swapper/008:15:080
2075799603,36cyclictest0-21swapper/009:50:510
2075799603,36cyclictest0-21swapper/009:50:510
20757996020,10cyclictest8946-21diskstats09:33:030
20757996014,14cyclictest0-21swapper/006:53:170
2076399593,50cyclictest0-21swapper/309:58:153
2076399592,51cyclictest0-21swapper/308:05:383
20762995945,8cyclictest29474-21ssh10:03:062
2076299593,49cyclictest432-21ssh08:33:052
2075799594,49cyclictest0-21swapper/010:30:240
2075799594,49cyclictest0-21swapper/010:30:240
2075799594,48cyclictest9787-21gltestperf07:58:100
2075799594,48cyclictest0-21swapper/007:28:120
2075799594,26cyclictest0-21swapper/009:04:180
2075799594,25cyclictest0-21swapper/009:41:180
2075799594,25cyclictest0-21swapper/007:50:340
20757995921,13cyclictest0-21swapper/009:26:020
20757995919,18cyclictest17877-21ssh08:58:080
20757995914,15cyclictest0-21swapper/010:15:100
38992583,12sleep20-21swapper/206:57:432
3027025812,38sleep21676-21nscd05:37:502
297572580,4sleep129876-21unixbench_singl05:33:301
2076399582,51cyclictest0-21swapper/310:09:483
2076299584,49cyclictest0-21swapper/208:27:442
20762995839,13cyclictest0-21swapper/208:18:342
2076299583,49cyclictest0-21swapper/210:42:442
2075799586,22cyclictest0-21swapper/010:23:360
2075799586,22cyclictest0-21swapper/010:23:360
2075799585,24cyclictest0-21swapper/008:19:590
2075799583,27cyclictest0-21swapper/009:52:590
20757995818,14cyclictest0-21swapper/006:08:240
20757995814,15cyclictest0-21swapper/005:18:280
20757995812,16cyclictest0-21swapper/005:23:180
2076399571,51cyclictest0-21swapper/307:22:283
20762995741,10cyclictest5183-21threads08:38:202
2076299574,9cyclictest22874-21ssh09:53:092
2076299574,48cyclictest0-21swapper/208:45:402
20762995739,12cyclictest0-21swapper/210:07:582
20762995736,14cyclictest0-21swapper/209:43:152
2076299573,47cyclictest1287-21snmpd06:37:082
20761995710,32cyclictest121850irq/46-eth009:52:291
20761995710,32cyclictest121850irq/46-eth009:52:291
2075799573,27cyclictest0-21swapper/007:13:090
20757995722,13cyclictest0-21swapper/005:38:070
20757995720,12cyclictest0-21swapper/007:08:250
20757995718,16cyclictest0-21swapper/005:33:000
20763995642,8cyclictest1287-21snmpd10:32:453
20763995642,8cyclictest1287-21snmpd10:32:453
2076399564,45cyclictest11380-21irqstats08:48:113
2076399562,49cyclictest1676-21nscd10:12:593
20762995641,8cyclictest26489-21ssh09:58:132
20762995641,10cyclictest0-21swapper/210:33:132
20762995638,12cyclictest0-21swapper/209:28:102
2076299563,48cyclictest0-21swapper/209:36:102
2076299563,48cyclictest0-21swapper/207:51:152
2076299562,48cyclictest0-21swapper/207:43:042
20761995627,12cyclictest0-21swapper/109:58:111
2075799565,28cyclictest0-21swapper/006:43:450
2075799564,30cyclictest0-21swapper/007:07:120
2075799564,29cyclictest0-21swapper/005:57:010
20757995618,13cyclictest0-21swapper/006:37:080
20757995615,13cyclictest0-21swapper/005:17:580
107502563,45sleep20-21swapper/206:03:142
8622553,6sleep1866-21ssh09:21:411
58012553,45sleep35922-21munin-node05:53:113
317582553,7sleep131762-21ssh08:31:061
317582553,7sleep131762-21ssh08:31:061
20763995540,8cyclictest9460-21munin-run10:22:443
20763995539,11cyclictest0-21swapper/310:02:573
2076299555,42cyclictest2960-21ssh10:12:492
20762995542,7cyclictest1400-21latency_hist06:52:522
20762995540,9cyclictest13486-21diskmemload08:28:052
20762995540,9cyclictest13486-21diskmemload08:28:052
2076299554,26cyclictest0-21swapper/208:48:092
20762995538,11cyclictest0-21swapper/208:17:402
20762995537,12cyclictest0-21swapper/210:47:442
20762995537,12cyclictest0-21swapper/209:02:592
20762995537,12cyclictest0-21swapper/205:58:202
2076299553,46cyclictest0-21swapper/205:23:262
2076299552,48cyclictest0-21swapper/210:24:242
2076299552,48cyclictest0-21swapper/210:24:242
2076299552,48cyclictest0-21swapper/207:00:372
2075799554,27cyclictest0-21swapper/006:48:240
2075799554,27cyclictest0-21swapper/006:42:540
2075799554,25cyclictest0-21swapper/006:18:070
20757995520,13cyclictest0-21swapper/006:13:220
20757995517,13cyclictest0-21swapper/006:27:060
2076399544,45cyclictest0-21swapper/305:33:133
20763995439,10cyclictest0-21swapper/306:12:553
2076399543,43cyclictest13486-21diskmemload08:33:393
2076299545,43cyclictest0-21swapper/209:38:192
20762995437,12cyclictest0-21swapper/208:57:442
20762995437,12cyclictest0-21swapper/206:41:432
2076299543,46cyclictest0-21swapper/207:53:062
2076299543,46cyclictest0-21swapper/206:13:072
2076299542,47cyclictest0-21swapper/209:23:412
2076399533,42cyclictest27894-21ls07:38:033
2076399533,41cyclictest12178-21ssh10:25:233
2076399533,41cyclictest12178-21ssh10:25:233
2076399533,11cyclictest14124-21df08:53:043
2076399532,46cyclictest0-21swapper/309:48:163
2076399532,46cyclictest0-21swapper/309:48:163
2076399532,46cyclictest0-21swapper/308:44:243
2076399532,46cyclictest0-21swapper/306:18:083
2076299533,43cyclictest1287-21snmpd07:07:122
2076199533,36cyclictest1287-21snmpd08:43:171
20761995325,13cyclictest0-21swapper/110:28:071
20761995325,13cyclictest0-21swapper/110:28:071
20761995324,11cyclictest0-21swapper/108:37:501
20761995316,9cyclictest16357-21fschecks_count08:08:081
2075799533,25cyclictest0-21swapper/005:43:080
2075799533,25cyclictest0-21swapper/005:43:080
259152523,9sleep126046-21cpuspeed_turbos05:28:101
210132522,10sleep30-21swapper/309:03:053
2076399524,41cyclictest7950-21ssh09:32:193
2076399524,41cyclictest19631-21ssh07:25:283
20763995233,12cyclictest0-21swapper/307:03:183
2076399523,44cyclictest0-21swapper/307:53:573
2076399522,46cyclictest0-21swapper/308:32:263
2076399522,46cyclictest0-21swapper/308:32:263
2076399522,46cyclictest0-21swapper/308:13:023
20762995235,12cyclictest0-21swapper/207:33:402
2076299523,42cyclictest1205-21ssh09:22:472
20761995215,25cyclictest0-21swapper/108:04:171
20761995212,14cyclictest0-21swapper/109:23:081
230262512,9sleep20-21swapper/205:21:422
20763995137,10cyclictest0-21swapper/309:33:033
2076399513,44cyclictest0-21swapper/310:35:343
2076399513,41cyclictest24696-21python10:43:153
2076399512,44cyclictest0-21swapper/306:53:153
20763995117,29cyclictest1419-21runrttasks08:40:103
20762995112,12cyclictest0-21swapper/205:43:102
20762995112,12cyclictest0-21swapper/205:43:102
84152502,9sleep10-21swapper/107:04:191
323782502,41sleep10-21swapper/105:39:101
20763995034,11cyclictest0-21swapper/309:41:533
20763995032,12cyclictest0-21swapper/306:33:253
20763995031,13cyclictest0-21swapper/305:48:093
20763995031,13cyclictest0-21swapper/305:48:093
2076399503,39cyclictest2091-21ssh09:23:033
2076399502,40cyclictest2414-21kworker/3:008:25:283
2076299506,36cyclictest0-21swapper/207:13:052
2076299505,37cyclictest0-21swapper/205:48:152
2076299505,37cyclictest0-21swapper/205:48:152
20761995029,10cyclictest0-21swapper/110:43:031
20761995027,8cyclictest18164-21crond09:47:461
133992503,7sleep113483-21hwlatdetect06:08:161
292772492,9sleep20-21swapper/206:43:032
276402492,9sleep30-21swapper/305:29:373
2076399493,38cyclictest13690-21latency_hist07:17:533
2076199494,29cyclictest0-21swapper/110:17:341
2076199493,41cyclictest1419-21runrttasks05:23:331
2076199493,29cyclictest0-21swapper/106:07:551
2076199493,28cyclictest0-21swapper/109:33:101
2076199493,19cyclictest23250-21ssh09:06:471
20761994927,10cyclictest0-21swapper/107:53:151
20761994923,12cyclictest0-21swapper/108:38:061
20761994921,13cyclictest0-21swapper/108:54:441
20761994921,12cyclictest0-21swapper/110:18:351
198702492,9sleep10-21swapper/107:26:241
98942483,7sleep19885-21yum-updatesd-he06:02:321
2076399484,37cyclictest0-21swapper/305:43:253
2076399484,37cyclictest0-21swapper/305:43:253
20763994835,8cyclictest21567-21forks05:18:133
2076299485,27cyclictest0-21swapper/207:08:042
2076299484,37cyclictest6527-21missed_timers05:53:202
20762994831,12cyclictest0-21swapper/206:23:162
20762994813,7cyclictest121850irq/46-eth006:08:072
2076199487,27cyclictest0-21swapper/107:21:391
20761994823,9cyclictest21624-21unixbench_multi10:38:171
20761994823,11cyclictest9750-21fschecks_time07:58:101
20761994810,25cyclictest121850irq/46-eth010:05:141
123512482,40sleep10-21swapper/110:26:031
123512482,40sleep10-21swapper/110:26:031
222262473,38sleep20-21swapper/206:28:082
222262473,38sleep20-21swapper/206:28:082
216582472,40sleep10-21swapper/106:24:571
20763994733,10cyclictest0-21swapper/306:48:233
2076399473,12cyclictest0-21swapper/305:58:133
2076299475,11cyclictest0-21swapper/206:18:292
2076199474,26cyclictest0-21swapper/108:19:581
2076199474,25cyclictest6134-21fschecks_time05:53:141
2076199474,25cyclictest0-21swapper/108:50:381
20761994728,13cyclictest0-21swapper/110:33:141
20761994723,7cyclictest28769-21ssh07:38:141
20761994722,9cyclictest20612-21munin-node07:28:141
199132472,6sleep119916-21ssh09:01:581
116112472,9sleep30-21swapper/306:03:273
41542462,9sleep10-21swapper/106:58:021
25652462,9sleep10-21swapper/105:45:231
25652462,9sleep10-21swapper/105:45:231
240252462,37sleep10-21swapper/106:29:411
240252462,37sleep10-21swapper/106:29:411
229432462,37sleep10-21swapper/105:20:361
2076399463,38cyclictest0-21swapper/306:32:543
2076399463,38cyclictest0-21swapper/306:32:543
20763994628,12cyclictest0-21swapper/305:38:073
2076199463,37cyclictest0-21swapper/106:13:231
2076199463,29cyclictest0-21swapper/109:08:531
2076199463,29cyclictest0-21swapper/109:08:531
2076199463,24cyclictest20516-21fgrep08:13:181
2076199463,21cyclictest27182-21munin-node09:13:181
20761994625,8cyclictest27435-21df_abs06:38:101
20761994621,9cyclictest9810-21sed07:08:121
20761994620,11cyclictest0-21swapper/109:54:041
2076399454,11cyclictest0-21swapper/305:23:093
20763994530,11cyclictest0-21swapper/305:17:583
2076399453,35cyclictest22103-21cat06:27:553
20763994529,12cyclictest0-21swapper/307:12:233
20763994529,11cyclictest0-21swapper/306:58:053
2076299454,35cyclictest0-21swapper/205:38:132
2076199454,36cyclictest0-21swapper/106:53:431
51492442,36sleep10-21swapper/105:52:531
51492442,36sleep10-21swapper/105:52:531
312352442,9sleep10-21swapper/106:45:241
2076399444,25cyclictest0-21swapper/306:43:263
2076199444,12cyclictest0-21swapper/107:48:081
2076199443,26cyclictest0-21swapper/106:33:201
20761994421,8cyclictest32514-21ssh10:08:021
287302432,35sleep30-21swapper/306:38:493
2076199434,33cyclictest0-21swapper/107:17:521
20761994330,7cyclictest0-21swapper/105:17:571
20761994322,10cyclictest0-21swapper/106:48:241
20761994321,10cyclictest0-21swapper/106:18:231
20762993518,9cyclictest20749-21munin-run05:17:572
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional