You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-13 - 15:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Mon Apr 13, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2560421520,43sleep01271599cyclictest10:06:260
146921040,4sleep01466-21grep07:56:160
12715991034,9cyclictest1419-21runrttasks07:17:430
1271599994,13cyclictest0-21swapper/009:31:150
1272499984,27cyclictest5455-21diskmemload08:41:312
1272499984,27cyclictest5455-21diskmemload08:41:312
1272499964,37cyclictest18117-21df08:21:132
1272499963,39cyclictest0-21swapper/208:53:362
1271599954,75cyclictest0-21swapper/008:56:190
1271599954,12cyclictest0-21swapper/008:11:110
12715999511,58cyclictest0-21swapper/008:01:130
12715999511,58cyclictest0-21swapper/008:01:130
1271599944,12cyclictest0-21swapper/007:35:590
1272499935,25cyclictest0-21swapper/210:11:182
12724999320,10cyclictest11900-21yum-updatesd-he09:00:392
12724999312,27cyclictest0-21swapper/209:45:542
1272499925,25cyclictest0-21swapper/207:22:352
1272499924,12cyclictest0-21swapper/208:15:222
1271599924,80cyclictest0-21swapper/009:16:100
1271599924,80cyclictest0-21swapper/009:16:100
1271599924,12cyclictest0-21swapper/010:36:030
1271599923,10cyclictest0-21swapper/010:25:340
1271599923,10cyclictest0-21swapper/010:15:420
1271599923,10cyclictest0-21swapper/009:56:230
1272499915,35cyclictest0-21swapper/207:20:592
1272499914,34cyclictest0-21swapper/209:26:032
1272499914,31cyclictest0-21swapper/208:10:572
1272499914,27cyclictest0-21swapper/210:41:142
1272499914,26cyclictest0-21swapper/209:02:032
1272499914,24cyclictest6042-21ssh10:26:162
1272499913,39cyclictest0-21swapper/208:38:262
1272499913,39cyclictest0-21swapper/208:38:262
12724999121,12cyclictest3792-21yum-updatesd-he08:00:402
12724999119,12cyclictest0-21swapper/209:37:382
12724999118,10cyclictest2792-21ssh08:46:132
1271599913,9cyclictest24392-21munin-node08:31:170
1271599913,62cyclictest9198-21basename07:21:110
1271599913,13cyclictest0-21swapper/008:38:150
1271599913,13cyclictest0-21swapper/008:38:150
1271599913,10cyclictest0-21swapper/010:30:160
1272499905,25cyclictest0-21swapper/209:41:042
1272499904,24cyclictest0-21swapper/209:35:392
1272499904,21cyclictest16987-21ssh09:06:212
1271599904,11cyclictest0-21swapper/007:41:100
1271599903,11cyclictest0-21swapper/007:54:400
1272499894,38cyclictest0-21swapper/207:36:322
1272499894,36cyclictest0-21swapper/210:19:292
1272499894,35cyclictest0-21swapper/206:06:212
1272499894,35cyclictest0-21swapper/206:06:212
1272499894,24cyclictest0-21swapper/210:33:012
1272499894,24cyclictest0-21swapper/210:22:062
1272499894,24cyclictest0-21swapper/210:04:412
1272499894,24cyclictest0-21swapper/210:04:412
1272499893,10cyclictest15676-21sshd09:51:452
12724998919,9cyclictest5882-21wc08:01:312
12724998919,9cyclictest5882-21wc08:01:312
12724998919,13cyclictest0-21swapper/207:51:182
12724998915,10cyclictest25598-21missed_timers08:31:212
1271599894,12cyclictest0-21swapper/009:09:250
1271599894,12cyclictest0-21swapper/006:56:180
1271599893,11cyclictest0-21swapper/007:26:330
1271599893,11cyclictest0-21swapper/007:26:330
12715998919,47cyclictest0-21swapper/007:46:330
12715998913,52cyclictest121850irq/46-eth007:40:590
1272499888,21cyclictest26989-21diskstats07:46:152
1272499884,24cyclictest0-21swapper/208:26:192
12724998834,45cyclictest16403-21cut07:31:142
1271599884,77cyclictest0-21swapper/010:17:300
1271599884,13cyclictest0-21swapper/008:41:100
1271599884,13cyclictest0-21swapper/008:41:100
1271599884,12cyclictest0-21swapper/009:26:140
1271599884,12cyclictest0-21swapper/006:36:150
1271599883,67cyclictest0-21swapper/009:01:430
248599870,5rtkit-daemon2484-21rtkit-daemon10:36:253
1272499875,30cyclictest24248-21unixbench_singl05:36:362
1272499874,28cyclictest0-21swapper/210:36:052
1272499874,23cyclictest0-21swapper/207:42:262
1272499873,12cyclictest0-21swapper/208:18:412
1271599874,8cyclictest7922-21kworker/0:108:06:280
1271599873,9cyclictest17271-21taskset10:42:300
1271599873,11cyclictest0-21swapper/009:47:470
1271599873,11cyclictest0-21swapper/008:26:060
12715998716,47cyclictest0-21swapper/009:41:040
12715998714,52cyclictest0-21swapper/006:18:470
1272499864,25cyclictest0-21swapper/207:26:222
1272499864,25cyclictest0-21swapper/207:26:222
1272499864,24cyclictest0-21swapper/209:55:542
12724998617,13cyclictest0-21swapper/210:08:362
12724998611,20cyclictest0-21swapper/209:11:262
1271599869,54cyclictest121850irq/46-eth005:36:300
1271599864,63cyclictest0-21swapper/008:22:500
1271599863,63cyclictest0-21swapper/010:05:510
1271599863,63cyclictest0-21swapper/010:05:510
1272499854,34cyclictest0-21swapper/206:26:012
1272499854,27cyclictest0-21swapper/206:41:212
1272499854,25cyclictest0-21swapper/209:21:122
1271599859,59cyclictest0-21swapper/009:54:410
1271599854,74cyclictest0-21swapper/009:11:090
1271599854,59cyclictest0-21swapper/009:36:240
1271599854,12cyclictest0-21swapper/010:31:100
1271599854,12cyclictest0-21swapper/007:10:590
12715998516,52cyclictest5455-21diskmemload08:49:420
12715998514,49cyclictest7922-21kworker/0:108:18:350
1272499849,13cyclictest0-21swapper/209:16:102
1272499849,13cyclictest0-21swapper/209:16:102
1272499844,34cyclictest0-21swapper/207:06:292
12724998422,19cyclictest29013-21sed05:46:362
12724998415,10cyclictest27021-21crond05:46:022
1271599844,11cyclictest0-21swapper/008:51:090
1271599844,10cyclictest15399-21open_inodes06:26:280
1272499834,40cyclictest0-21swapper/206:26:152
12724998317,13cyclictest0-21swapper/206:01:152
1271599834,13cyclictest0-21swapper/009:21:160
1272499824,31cyclictest0-21swapper/205:56:232
1272499813,26cyclictest0-21swapper/206:36:172
1271599814,70cyclictest0-21swapper/005:45:580
1271599814,12cyclictest0-21swapper/006:51:160
1271599814,12cyclictest0-21swapper/006:11:320
1271599814,12cyclictest0-21swapper/005:21:040
12715998116,49cyclictest0-21swapper/006:06:310
12715998116,49cyclictest0-21swapper/006:06:310
1272499804,25cyclictest0-21swapper/206:31:112
1272499804,12cyclictest0-21swapper/206:51:002
1271599804,58cyclictest0-21swapper/006:41:290
1271599804,12cyclictest0-21swapper/006:21:330
1271599803,8cyclictest3587-21python06:01:340
1272499794,29cyclictest0-21swapper/205:28:392
1272499794,29cyclictest0-21swapper/205:28:392
12724997927,13cyclictest1419-21runrttasks07:05:052
1271599793,10cyclictest0-21swapper/005:51:310
1271599776,63cyclictest0-21swapper/006:51:010
1271599774,11cyclictest0-21swapper/007:06:000
1272499764,24cyclictest0-21swapper/205:51:192
1272499763,25cyclictest0-21swapper/206:51:322
1271599763,9cyclictest3642-21grep07:11:140
12715997610,56cyclictest0-21swapper/005:56:200
1272499754,25cyclictest0-21swapper/206:18:472
1272499754,24cyclictest0-21swapper/205:16:152
1271599754,12cyclictest0-21swapper/005:21:220
1271599754,12cyclictest0-21swapper/005:21:220
1271599753,65cyclictest16539-21tail06:31:120
12715997516,43cyclictest0-21swapper/005:31:220
1272499744,32cyclictest0-21swapper/206:11:122
12724997414,24cyclictest0-21swapper/206:56:202
1271599745,61cyclictest12705-21cyclictest05:16:030
12725997317,40cyclictest0-21swapper/307:17:563
1271599733,55cyclictest0-21swapper/005:46:150
12725997222,30cyclictest8132-21diskstats08:06:133
1271599724,61cyclictest0-21swapper/005:26:250
1271599724,61cyclictest0-21swapper/005:26:250
12725997113,49cyclictest31986-21processes10:16:213
248599690,4rtkit-daemon2484-21rtkit-daemon10:00:343
12725996920,41cyclictest11209-21ssh10:35:013
1272499694,32cyclictest0-21swapper/207:15:592
12725996823,27cyclictest7808-21gltestperf09:41:123
12725996822,27cyclictest31826-21grep05:56:023
12725996821,39cyclictest12614-21cpuspeed_turbos09:01:103
12725996820,26cyclictest2510-21timerwakeupswit07:56:303
12725996816,45cyclictest0-21swapper/308:31:143
12725996720,28cyclictest0-21swapper/307:24:173
173932660,4sleep117496-21ssh08:20:571
12725996625,34cyclictest1419-21runrttasks08:25:593
12725996623,34cyclictest23367-21cpuspeed_turbos07:41:113
12725996621,30cyclictest7150-21seq10:27:303
12725996619,40cyclictest0-21swapper/309:18:423
12725996619,40cyclictest0-21swapper/309:18:423
12725996521,36cyclictest19997-21seq08:23:093
12725996513,43cyclictest0-21swapper/306:41:123
248599640,4rtkit-daemon2484-21rtkit-daemon10:42:103
12725996444,13cyclictest15006-21sed06:26:213
12725996421,34cyclictest19480-21fschecks_count06:36:203
12725996419,37cyclictest17781-21seq09:07:163
12725996419,26cyclictest13104-21processes06:21:313
12725996418,38cyclictest10086-21perl06:16:203
12725996417,39cyclictest0-21swapper/308:36:293
12725996417,39cyclictest0-21swapper/308:36:293
12725996415,41cyclictest0-21swapper/309:50:583
12725996414,43cyclictest0-21swapper/307:31:423
42422634,49sleep10-21swapper/108:01:101
42422634,49sleep10-21swapper/108:01:101
1272599637,34cyclictest0-21swapper/309:34:443
12725996320,35cyclictest29415-21wc09:26:053
12725996316,29cyclictest0-21swapper/308:02:083
12725996316,29cyclictest0-21swapper/308:02:083
12725996316,21cyclictest0-21swapper/307:36:283
12725996315,41cyclictest0-21swapper/307:48:003
12725996314,42cyclictest0-21swapper/309:14:473
12725996312,44cyclictest0-21swapper/308:19:123
12725996310,45cyclictest0-21swapper/308:46:103
12725996223,23cyclictest13466-21tail07:26:203
12725996223,23cyclictest13466-21tail07:26:203
12725996221,35cyclictest54551diskmemload08:11:013
12725996218,29cyclictest0-21swapper/310:02:123
12725996218,29cyclictest0-21swapper/310:02:123
12725996218,28cyclictest65451rm09:40:213
12725996216,38cyclictest26075-21grep09:21:073
12725996216,27cyclictest1938-21df10:21:073
12725996213,42cyclictest0-21swapper/309:46:283
12725996213,31cyclictest0-21swapper/308:41:033
12725996213,31cyclictest0-21swapper/308:41:033
12725996211,43cyclictest0-21swapper/307:51:153
11932623,51sleep10-21swapper/105:56:351
12725996121,33cyclictest0-21swapper/305:37:223
12725996120,26cyclictest26021-21munin-node06:51:243
12725996115,39cyclictest28286-21iostat_ios05:46:253
12725996114,38cyclictest4538-21netstat07:11:263
12725996113,40cyclictest0-21swapper/305:26:033
12725996113,40cyclictest0-21swapper/305:26:033
12725996113,32cyclictest0-21swapper/308:54:133
130452600,4sleep113046-21hostname05:16:151
12725996017,28cyclictest26691-21ssh10:10:073
12725996011,33cyclictest0-21swapper/309:00:293
221592593,48sleep10-21swapper/105:34:551
12725995918,34cyclictest27081-21cat05:46:023
12725995916,35cyclictest32160-21aten2.4-expect05:56:143
12725995915,28cyclictest0-21swapper/305:28:453
12725995915,28cyclictest0-21swapper/305:28:453
12725995914,29cyclictest0-21swapper/310:12:213
12720995939,12cyclictest19438-21cut09:11:091
12720995921,32cyclictest22669-21sendmail_mailqu06:41:291
12720995921,24cyclictest1419-21runrttasks08:54:101
12725995811,39cyclictest0-21swapper/307:01:323
1272099585,33cyclictest0-21swapper/109:01:251
12720995837,13cyclictest3344-21tr06:01:281
12725995719,32cyclictest22357-21cat05:36:043
12725995713,36cyclictest0-21swapper/305:16:163
1272099575,37cyclictest20319-21smartctl06:36:331
12720995713,27cyclictest12043-21latency_hist09:00:551
248599560,6rtkit-daemon2484-21rtkit-daemon07:00:493
12725995619,12cyclictest1673-21http_loadtime07:06:193
1272599557,41cyclictest0-21swapper/306:31:223
12725995511,37cyclictest0-21swapper/306:06:023
1272099544,15cyclictest0-21swapper/108:45:031
1272099544,15cyclictest0-21swapper/108:45:031
15752533,7sleep11604-21python09:31:241
12725995326,20cyclictest7802-21gltestperf06:11:213
12725995323,24cyclictest23726-21cut06:46:113
12725995323,23cyclictest5057-21df_abs06:06:173
12725995323,23cyclictest5057-21df_abs06:06:173
1272099536,29cyclictest0-21swapper/108:06:261
1272099535,29cyclictest0-21swapper/109:37:351
1272099535,26cyclictest0-21swapper/108:22:461
1272099535,15cyclictest0-21swapper/107:49:571
1272099535,12cyclictest29729-21diskstats09:26:091
1272099534,31cyclictest0-21swapper/110:41:061
12720995310,20cyclictest0-21swapper/107:11:121
229992523,42sleep10-21swapper/107:41:021
1272099525,28cyclictest0-21swapper/110:35:201
1272099525,26cyclictest0-21swapper/106:21:251
1272099525,14cyclictest0-21swapper/110:09:331
1272099524,40cyclictest1287-21snmpd07:40:581
1272099524,30cyclictest0-21swapper/105:46:201
12720995235,10cyclictest25347-21sed06:46:331
12720995221,11cyclictest6037-21ssh10:26:161
12720995219,13cyclictest25451-21irqstats08:31:191
87442512,13sleep10-21swapper/106:11:461
44072512,12sleep10-21swapper/108:47:421
302792512,10sleep10-21swapper/108:38:511
302792512,10sleep10-21swapper/108:38:511
162132515,39sleep10-21swapper/106:30:411
160202513,13sleep10-21swapper/109:53:011
143582512,13sleep10-21swapper/110:39:131
1272099515,28cyclictest0-21swapper/107:06:271
1272099514,29cyclictest0-21swapper/107:31:201
1272099514,29cyclictest0-21swapper/107:16:141
1272099514,28cyclictest0-21swapper/110:21:061
1272099514,27cyclictest0-21swapper/109:05:571
1272099514,26cyclictest10925-21ssh09:46:111
1272099513,43cyclictest0-21swapper/108:28:151
1272099513,40cyclictest0-21swapper/109:56:141
12720995129,15cyclictest0-21swapper/110:16:081
12720995118,11cyclictest29734-21munin-node06:56:291
1272099505,27cyclictest0-21swapper/110:01:291
1272099505,27cyclictest0-21swapper/110:01:291
1272099505,25cyclictest12335-21systemd-cgroups07:25:591
1272099504,28cyclictest0-21swapper/105:26:171
1272099504,28cyclictest0-21swapper/105:26:171
1272099504,25cyclictest0-21swapper/109:16:041
1272099504,25cyclictest0-21swapper/109:16:041
12720995022,9cyclictest1-21systemd10:11:021
279052493,40sleep10-21swapper/106:52:331
224842494,37sleep10-21swapper/105:36:071
172882492,12sleep10-21swapper/105:23:381
172882492,12sleep10-21swapper/105:23:381
1272499495,27cyclictest0-21swapper/205:31:292
1272099495,26cyclictest0-21swapper/108:11:061
1272099495,22cyclictest0-21swapper/107:56:191
1272099494,27cyclictest0-21swapper/105:41:241
1272099494,26cyclictest15775-21idleruntime-cro07:30:581
1272099494,26cyclictest15775-21idleruntime-cro07:30:581
1272099494,25cyclictest5455-21diskmemload07:51:321
1272099494,12cyclictest0-21swapper/109:21:061
12720994929,12cyclictest17316-21head06:31:191
12720994919,12cyclictest0-21swapper/109:41:381
314712483,10sleep10-21swapper/105:51:511
1272499484,27cyclictest0-21swapper/205:21:172
1272499484,27cyclictest0-21swapper/205:21:172
12720994817,13cyclictest0-21swapper/107:01:131
1272099474,27cyclictest0-21swapper/106:06:431
1272099474,27cyclictest0-21swapper/106:06:431
1272099474,25cyclictest0-21swapper/106:16:141
125642453,36sleep10-21swapper/105:14:321
12725994313,12cyclictest0-21swapper/305:16:043
124632424,6sleep20-21swapper/205:13:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional