You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-14 - 17:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Mon Sep 14, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1691399973,10cyclictest24266-21sed07:48:151
1691399973,10cyclictest24266-21sed07:48:151
1691399964,12cyclictest0-21swapper/107:38:131
1691399953,12cyclictest0-21swapper/106:13:111
1691399943,11cyclictest0-21swapper/110:16:251
1691399923,9cyclictest21670-21ls07:43:281
1691399923,9cyclictest21670-21ls07:43:281
1691399923,13cyclictest0-21swapper/108:21:501
317962910,3sleep041ktimersoftd/007:03:280
1691399914,13cyclictest0-21swapper/109:46:441
1691399914,13cyclictest0-21swapper/109:46:441
1691399913,10cyclictest17659-21taskset09:17:241
1691399904,13cyclictest0-21swapper/108:43:261
1691399904,12cyclictest0-21swapper/108:48:241
1691399904,12cyclictest0-21swapper/107:55:251
1691399903,9cyclictest2856-21needreboot08:53:201
1691399903,62cyclictest0-21swapper/108:28:521
1691399903,62cyclictest0-21swapper/108:28:521
1691399903,13cyclictest0-21swapper/107:33:161
1691399903,12cyclictest0-21swapper/109:20:501
16913999018,51cyclictest0-21swapper/110:03:411
1691399894,13cyclictest0-21swapper/110:01:121
1691399894,12cyclictest0-21swapper/109:35:291
1691399894,12cyclictest0-21swapper/108:42:021
1691399894,11cyclictest0-21swapper/109:28:281
1691399888,11cyclictest0-21swapper/110:21:441
1691399884,13cyclictest0-21swapper/109:06:021
1691399884,13cyclictest0-21swapper/109:06:021
1691399884,12cyclictest0-21swapper/110:33:341
1691399884,12cyclictest0-21swapper/109:24:281
1691399884,10cyclictest15690-21python08:23:251
1691399874,63cyclictest0-21swapper/110:11:541
1691399874,63cyclictest0-21swapper/109:53:051
1691399874,12cyclictest0-21swapper/110:49:501
1691399874,11cyclictest0-21swapper/110:24:151
1691399874,11cyclictest0-21swapper/107:28:521
1691399873,62cyclictest13875-21yum-updatesd-he09:10:321
1691399873,62cyclictest13875-21yum-updatesd-he09:10:321
1691399873,10cyclictest30960-21hwlatdetect07:58:151
1691399864,64cyclictest0-21swapper/108:16:431
1691399864,12cyclictest0-21swapper/108:10:581
1691399864,12cyclictest0-21swapper/105:43:131
1691399864,11cyclictest0-21swapper/110:44:491
16913998618,48cyclictest0-21swapper/110:53:081
16913998612,9cyclictest51531telnet07:18:081
1691399854,12cyclictest0-21swapper/106:33:131
1691399854,11cyclictest0-21swapper/110:32:491
1691399854,11cyclictest0-21swapper/110:32:491
1691399843,9cyclictest6669-21diskstats10:38:051
1691399834,62cyclictest0-21swapper/109:48:061
1691399834,61cyclictest0-21swapper/108:33:161
1691399834,12cyclictest0-21swapper/109:38:201
1691399834,12cyclictest0-21swapper/107:03:141
1691399833,12cyclictest0-21swapper/105:48:181
16913998316,49cyclictest0-21swapper/108:59:581
16913998315,8cyclictest1124-21snmpd07:15:571
1691399824,12cyclictest0-21swapper/106:03:161
16913998118,41cyclictest0-21swapper/107:25:591
16913998113,9cyclictest1669-21grep08:03:121
1691399804,60cyclictest0-21swapper/106:48:291
1691399804,12cyclictest0-21swapper/105:53:181
1691399794,57cyclictest0-21swapper/105:38:011
1691399784,12cyclictest0-21swapper/106:28:241
1691399779,60cyclictest0-21swapper/106:43:211
1691399777,8cyclictest107550irq/46-eth006:18:221
1691399774,56cyclictest0-21swapper/107:08:121
1691399774,56cyclictest0-21swapper/107:08:121
1691399774,12cyclictest0-21swapper/107:02:581
1691399764,12cyclictest0-21swapper/105:28:311
219499750,5rtkit-daemon2193-21rtkit-daemon10:23:482
219499750,4rtkit-daemon2193-21rtkit-daemon09:15:282
1691399753,64cyclictest11408-21cpuspeed_turbos06:23:131
1691399753,64cyclictest11408-21cpuspeed_turbos06:23:131
16913997520,49cyclictest26278-21gltestperf06:53:171
16913997510,8cyclictest22918-21iostat05:38:231
16913997510,8cyclictest22918-21iostat05:38:231
16913997413,44cyclictest0-21swapper/105:58:121
16914997318,47cyclictest0-21swapper/208:43:082
1691399725,12cyclictest0-21swapper/105:28:001
1691399723,11cyclictest5904-21yum-updatesd-he06:10:461
16913997118,46cyclictest19503-21netstat06:38:231
219499700,5rtkit-daemon2193-21rtkit-daemon10:00:262
219499700,5rtkit-daemon2193-21rtkit-daemon09:05:212
219499700,5rtkit-daemon2193-21rtkit-daemon09:05:212
219499690,5rtkit-daemon2193-21rtkit-daemon06:05:212
219499690,4rtkit-daemon2193-21rtkit-daemon08:23:452
219499690,4rtkit-daemon2193-21rtkit-daemon08:22:152
16914996918,44cyclictest4618-21crond08:57:522
16914996913,49cyclictest0-21swapper/209:00:032
219499680,5rtkit-daemon2193-21rtkit-daemon08:51:222
1691499687,44cyclictest0-21swapper/207:07:572
1691499687,23cyclictest0-21swapper/210:41:042
16914996820,41cyclictest9702-21gltestperf09:53:122
16914996814,34cyclictest0-21swapper/207:53:182
16914996812,48cyclictest0-21swapper/210:15:582
219499670,4rtkit-daemon2193-21rtkit-daemon05:38:592
219499670,4rtkit-daemon2193-21rtkit-daemon05:38:592
16914996721,38cyclictest1227-21runrttasks06:54:042
16914996718,30cyclictest17199-21unixbench_singl10:03:232
16914996716,43cyclictest0-21swapper/210:28:032
16914996716,43cyclictest0-21swapper/210:28:032
219499660,4rtkit-daemon2193-21rtkit-daemon10:45:552
16914996618,40cyclictest1227-21runrttasks09:22:562
16914996616,44cyclictest0-21swapper/210:53:212
16914996615,44cyclictest0-21swapper/207:38:262
16914996611,40cyclictest0-21swapper/210:10:522
1691599654,45cyclictest0-21swapper/309:09:433
1691599654,45cyclictest0-21swapper/309:09:433
16914996517,28cyclictest31801-21ssh09:38:072
16914996517,28cyclictest25245-21ssh08:38:172
16914996511,47cyclictest0-21swapper/207:47:562
16914996511,47cyclictest0-21swapper/207:47:562
16914996435,13cyclictest29242-21ntp_kernel_pll_09:33:192
16914996416,41cyclictest0-21swapper/210:20:532
16914996416,30cyclictest13831-21ssh07:33:122
16914996416,28cyclictest24857-21sort09:28:032
16914996412,32cyclictest0-21swapper/207:58:132
16915996323,11cyclictest1227-21runrttasks10:15:073
16914996314,33cyclictest180451munin-node09:18:192
16914996314,32cyclictest0-21swapper/208:33:032
16914996313,43cyclictest0-21swapper/207:28:222
16914996313,34cyclictest0-21swapper/208:04:152
16914996312,45cyclictest0-21swapper/207:48:182
16914996312,45cyclictest0-21swapper/207:48:182
290162623,50sleep00-21swapper/009:33:170
16914996213,42cyclictest0-21swapper/208:08:252
59762610,4sleep226-21rcuc/209:48:052
16914996116,38cyclictest0-21swapper/209:08:072
16914996116,38cyclictest0-21swapper/209:08:072
16914996116,27cyclictest13506-21grep10:48:072
16914996115,37cyclictest0-21swapper/207:17:562
16914996113,29cyclictest1227-21runrttasks06:35:222
16914996111,43cyclictest0-21swapper/206:48:192
16914996111,35cyclictest0-21swapper/208:28:222
16914996111,35cyclictest0-21swapper/208:28:222
1691199613,43cyclictest0-21swapper/007:35:370
189332603,49sleep00-21swapper/007:40:010
16914996013,40cyclictest0-21swapper/206:38:202
16914996011,42cyclictest0-21swapper/209:47:292
16914996011,42cyclictest0-21swapper/209:47:292
16914996010,43cyclictest0-21swapper/208:13:112
1691199604,48cyclictest0-21swapper/009:38:080
1691499598,42cyclictest0-21swapper/210:33:062
16914995911,20cyclictest0-21swapper/206:27:582
16914995911,20cyclictest0-21swapper/206:27:582
16911995928,24cyclictest0-21swapper/008:42:530
226762583,49sleep00-21swapper/007:46:140
226762583,49sleep00-21swapper/007:46:140
16915995818,21cyclictest1761-21Xorg09:41:493
1691199584,44cyclictest0-21swapper/009:13:120
52762575,11sleep00-21swapper/010:35:450
188182572,11sleep00-21swapper/010:57:100
1691499577,28cyclictest0-21swapper/206:43:092
16914995712,38cyclictest0-21swapper/206:18:162
16914995710,29cyclictest0-21swapper/207:08:112
16914995710,29cyclictest0-21swapper/207:08:112
1691199576,42cyclictest1227-21runrttasks08:37:540
1691199575,37cyclictest0-21swapper/010:32:290
1691199575,37cyclictest0-21swapper/010:32:290
1691199574,31cyclictest0-21swapper/010:45:480
16911995733,15cyclictest0-21swapper/010:27:490
251842563,11sleep00-21swapper/010:17:510
16915995638,11cyclictest18430-21grep08:28:133
16915995638,11cyclictest18430-21grep08:28:133
16915995619,22cyclictest20088-21ssh09:19:013
1691499569,39cyclictest0-21swapper/206:08:172
1691499568,30cyclictest0-21swapper/206:13:202
1691199564,45cyclictest0-21swapper/008:31:450
1691199564,45cyclictest0-21swapper/008:31:450
16911995637,11cyclictest1881-21cstates08:53:090
16911995611,37cyclictest0-21swapper/010:03:490
108922563,46sleep00-21swapper/009:06:440
108922563,46sleep00-21swapper/009:06:440
1691599555,29cyclictest0-21swapper/309:43:023
1691599555,29cyclictest0-21swapper/309:43:023
16915995523,12cyclictest0-21swapper/306:13:313
1691499559,26cyclictest19281-21latency_hist05:33:012
1691199554,45cyclictest0-21swapper/007:58:170
1691199554,43cyclictest0-21swapper/010:08:070
16911995533,12cyclictest30901-21ssh08:48:050
1691199553,12cyclictest0-21swapper/008:45:000
16911995526,22cyclictest0-21swapper/010:40:240
193722542,10sleep30-21swapper/307:41:413
1691599544,30cyclictest0-21swapper/307:53:223
1691599544,29cyclictest0-21swapper/307:43:243
1691599544,29cyclictest0-21swapper/307:43:243
16915995438,10cyclictest9687-21cut09:53:123
1691499547,31cyclictest0-21swapper/205:43:262
1691499546,41cyclictest0-21swapper/207:18:152
16914995424,24cyclictest29927-21gltestperf05:53:212
16914995419,28cyclictest8602-21latency07:23:202
1691199545,31cyclictest0-21swapper/006:18:110
1691199545,22cyclictest0-21swapper/008:13:460
1691199544,43cyclictest0-21swapper/009:53:080
1691199544,43cyclictest0-21swapper/009:01:080
1691199544,43cyclictest0-21swapper/007:28:230
16911995435,11cyclictest6418-21sed09:48:100
16911995431,14cyclictest13573-21gltestperf10:48:070
16911995422,13cyclictest0-21swapper/008:10:360
167562543,44sleep30-21swapper/309:13:573
57712532,12sleep00-21swapper/006:08:550
293242533,44sleep00-21swapper/007:56:170
178792533,43sleep00-21swapper/005:28:200
1691599534,41cyclictest0-21swapper/310:42:543
1691599534,28cyclictest0-21swapper/309:32:533
16915995320,14cyclictest0-21swapper/309:58:183
16915995310,22cyclictest0-21swapper/310:18:003
16914995312,35cyclictest13655-21aten2.4-expect06:28:112
1691199535,42cyclictest0-21swapper/009:43:170
1691199535,42cyclictest0-21swapper/009:43:170
1691199535,15cyclictest0-21swapper/009:59:540
16911995333,13cyclictest0-21swapper/010:13:130
16911995327,10cyclictest25673-21sh09:28:120
16911995324,21cyclictest6145-21runrttasks07:18:200
93392523,43sleep00-21swapper/007:24:000
219499520,6rtkit-daemon2193-21rtkit-daemon05:35:522
19632523,10sleep30-21swapper/310:31:053
19632523,10sleep30-21swapper/310:31:053
1691599525,28cyclictest0-21swapper/310:23:063
1691599524,42cyclictest0-21swapper/308:18:203
1691599524,30cyclictest0-21swapper/307:58:173
16915995214,16cyclictest0-21swapper/307:07:573
16914995227,7cyclictest29972-21latency_hist07:02:582
1691199524,42cyclictest0-21swapper/008:23:120
16911995235,10cyclictest21507-21sed06:43:170
16911995234,11cyclictest12351-21tail09:08:100
16911995234,11cyclictest12351-21tail09:08:100
16911995223,8cyclictest0-21swapper/005:58:010
16911995212,23cyclictest12180-21ssh08:18:190
219499510,5rtkit-daemon2193-21rtkit-daemon05:50:142
21772513,10sleep00-21swapper/007:09:500
21772513,10sleep00-21swapper/007:09:500
1691599515,28cyclictest0-21swapper/308:58:223
1691599514,42cyclictest0-21swapper/307:33:253
1691599514,28cyclictest0-21swapper/310:03:143
1691599514,28cyclictest0-21swapper/307:17:583
1691599514,12cyclictest0-21swapper/308:46:123
1691599513,41cyclictest5082-21cut08:08:123
16915995111,22cyclictest0-21swapper/305:58:003
16914995116,28cyclictest32466-21iostat_ios05:58:222
1691199516,28cyclictest0-21swapper/006:13:240
1691199515,28cyclictest0-21swapper/005:33:170
1691199514,40cyclictest0-21swapper/006:53:190
16911995123,21cyclictest0-21swapper/009:20:330
48312504,39sleep00-21swapper/007:17:440
278082503,40sleep00-21swapper/006:58:000
263812503,41sleep00-21swapper/005:47:220
1691599505,29cyclictest0-21swapper/308:48:133
1691599504,28cyclictest0-21swapper/309:23:183
1691599504,28cyclictest0-21swapper/306:38:173
1691599504,28cyclictest0-21swapper/305:43:233
1691599504,27cyclictest0-21swapper/310:33:223
1691599504,27cyclictest0-21swapper/306:52:583
1691599504,26cyclictest0-21swapper/307:52:563
1691599504,26cyclictest0-21swapper/307:52:563
16915995033,11cyclictest21619-21gltestperf08:33:123
1691599503,41cyclictest0-21swapper/309:04:463
1691599503,41cyclictest0-21swapper/309:04:463
1691599503,37cyclictest0-21swapper/307:28:073
16915995019,14cyclictest0-21swapper/308:42:293
1691199505,38cyclictest0-21swapper/008:03:100
1691199505,27cyclictest0-21swapper/006:37:590
1691199505,25cyclictest0-21swapper/007:48:030
1691199505,25cyclictest0-21swapper/007:48:030
1691199504,38cyclictest0-21swapper/009:22:570
1691199504,28cyclictest0-21swapper/006:48:310
16911995029,14cyclictest0-21swapper/005:58:300
16911995021,12cyclictest0-21swapper/006:25:480
16911995021,12cyclictest0-21swapper/006:25:480
108322502,9sleep30-21swapper/306:22:283
219499490,4rtkit-daemon2193-21rtkit-daemon05:23:152
1691599496,36cyclictest0-21swapper/306:08:163
1691599495,27cyclictest0-21swapper/310:11:383
1691599494,39cyclictest0-21swapper/308:13:123
1691599494,27cyclictest0-21swapper/308:23:073
1691599494,27cyclictest0-21swapper/308:03:113
1691599494,27cyclictest0-21swapper/306:57:573
1691599494,27cyclictest0-21swapper/305:38:203
1691599494,27cyclictest0-21swapper/305:38:203
1691599494,27cyclictest0-21swapper/305:37:573
1691599494,26cyclictest0-21swapper/310:53:083
16915994934,9cyclictest17460-21cpuspeed_turbos05:28:143
1691599493,40cyclictest0-21swapper/309:49:393
1691599493,28cyclictest0-21swapper/309:31:213
1691199495,27cyclictest0-21swapper/005:48:310
1691199494,28cyclictest0-21swapper/006:03:270
134922493,39sleep00-21swapper/006:28:060
1691599484,26cyclictest0-21swapper/306:05:453
1691599484,25cyclictest0-21swapper/310:38:283
1691599484,12cyclictest0-21swapper/308:56:203
1691599483,27cyclictest0-21swapper/307:10:393
1691599483,27cyclictest0-21swapper/307:10:393
1691599483,25cyclictest0-21swapper/310:51:543
16911994827,14cyclictest0-21swapper/006:38:270
166842484,6sleep00-21swapper/005:25:300
10892482,39sleep30-21swapper/306:02:053
69772472,10sleep30-21swapper/307:19:203
1691599474,35cyclictest0-21swapper/306:43:253
1691599474,25cyclictest0-21swapper/306:35:503
1691599474,25cyclictest0-21swapper/305:53:013
16915994618,13cyclictest0-21swapper/306:58:213
1691199463,27cyclictest0-21swapper/005:38:250
1691199463,27cyclictest0-21swapper/005:38:250
1691599454,12cyclictest0-21swapper/306:28:293
1691599444,13cyclictest0-21swapper/307:23:243
16915994117,10cyclictest0-21swapper/306:23:133
16915994117,10cyclictest0-21swapper/306:23:133
1691599388,12cyclictest0-21swapper/305:28:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional