You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-25 - 13:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Sat Apr 25, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
102939910439,12cyclictest0-21swapper/010:19:540
10297991023,92cyclictest0-21swapper/109:05:041
102939910138,10cyclictest0-21swapper/008:30:060
102939910118,10cyclictest1419-21runrttasks08:27:140
10293991004,42cyclictest0-21swapper/009:15:010
1029899994,86cyclictest12095-21ssh08:05:142
1029799984,86cyclictest0-21swapper/109:49:581
1029399974,47cyclictest0-21swapper/009:50:080
1029899964,84cyclictest0-21swapper/207:49:402
1029899954,68cyclictest0-21swapper/208:04:412
1029899954,68cyclictest0-21swapper/208:04:412
1029899954,66cyclictest0-21swapper/208:54:502
1029799954,83cyclictest0-21swapper/109:16:301
10293999515,36cyclictest23253-21grep07:35:020
10293999435,13cyclictest0-21swapper/008:34:560
10293999433,14cyclictest0-21swapper/009:05:120
1029899924,81cyclictest0-21swapper/210:04:512
10293999234,15cyclictest0-21swapper/009:44:550
1029899914,79cyclictest0-21swapper/210:19:022
1029899914,70cyclictest0-21swapper/209:57:022
1029799913,82cyclictest0-21swapper/109:09:591
1029899904,79cyclictest0-21swapper/209:14:522
1029899904,68cyclictest0-21swapper/206:30:112
1029899904,66cyclictest0-21swapper/209:44:492
1029899904,49cyclictest19727-21ntpdc09:05:052
1029799904,79cyclictest0-21swapper/109:54:521
1029799903,78cyclictest29197-21runrttasks08:30:561
1029899894,78cyclictest15716-21taskset08:59:572
1029899894,78cyclictest1419-21runrttasks10:00:022
1029899893,51cyclictest121850irq/46-eth008:50:022
1029899893,50cyclictest0-21swapper/208:40:412
1029899893,50cyclictest0-21swapper/208:40:412
1029799893,80cyclictest0-21swapper/107:20:511
1029799893,79cyclictest0-21swapper/107:25:181
1029799893,79cyclictest0-21swapper/107:25:181
1029899886,75cyclictest30748-21cpuspeed08:34:532
1029899884,45cyclictest5612-21fschecks_count08:44:572
1029899884,45cyclictest5612-21fschecks_count08:44:572
1029899883,78cyclictest4989-21ps07:55:102
1029899883,78cyclictest0-21swapper/209:20:282
1029899883,78cyclictest0-21swapper/207:16:252
1029799884,77cyclictest0-21swapper/109:37:451
1029799883,77cyclictest0-21swapper/110:04:551
1029899875,74cyclictest0-21swapper/209:11:072
1029899874,65cyclictest30812-21tr05:50:012
1029899874,65cyclictest0-21swapper/209:39:372
1029899873,77cyclictest0-21swapper/210:33:432
1029899873,77cyclictest0-21swapper/208:12:562
1029899873,77cyclictest0-21swapper/207:31:072
1029799874,76cyclictest0-21swapper/107:05:111
1029799873,78cyclictest6419-21sendmail_mailtr08:45:091
1029799873,78cyclictest6419-21sendmail_mailtr08:45:091
1029799872,79cyclictest0-21swapper/108:14:401
1029899864,75cyclictest0-21swapper/210:10:282
1029899864,75cyclictest0-21swapper/210:10:282
1029899864,75cyclictest0-21swapper/207:39:462
1029899864,64cyclictest0-21swapper/209:52:012
1029899864,64cyclictest0-21swapper/205:38:312
1029899863,65cyclictest0-21swapper/208:15:562
1029799864,75cyclictest1419-21runrttasks07:34:091
1029799864,74cyclictest18150-21munin-run09:04:371
1029799863,77cyclictest0-21swapper/110:17:071
1029799863,76cyclictest14767-21munin-node09:45:101
1029799863,75cyclictest636-21fschecks_count07:50:011
1029799863,75cyclictest29707-21missed_timers09:20:021
1029799863,74cyclictest9417-21munin-node08:50:021
1029899854,75cyclictest0-21swapper/207:49:452
1029899854,65cyclictest0-21swapper/208:27:452
1029899854,64cyclictest0-21swapper/209:33:182
1029899854,51cyclictest0-21swapper/210:22:322
1029799854,74cyclictest0-21swapper/109:39:541
1029799854,74cyclictest0-21swapper/105:50:031
1029799853,76cyclictest0-21swapper/109:29:491
10297998513,51cyclictest0-21swapper/107:19:421
1029899844,71cyclictest23670-21munin-node07:35:092
1029899844,58cyclictest0-21swapper/206:50:032
1029899843,66cyclictest0-21swapper/209:40:072
1029799844,65cyclictest0-21swapper/108:19:411
1029799843,75cyclictest0-21swapper/110:30:011
1029799843,75cyclictest0-21swapper/108:36:351
1029799843,74cyclictest0-21swapper/107:10:281
1029899834,65cyclictest0-21swapper/210:25:242
1029899834,61cyclictest0-21swapper/208:32:082
1029899834,50cyclictest0-21swapper/208:21:452
1029899833,73cyclictest0-21swapper/205:40:092
1029899833,65cyclictest702-21ssh09:25:042
1029899833,65cyclictest702-21ssh09:25:042
1029899833,65cyclictest0-21swapper/207:24:462
1029899833,65cyclictest0-21swapper/207:24:462
1029899833,64cyclictest6774-21ssh07:10:152
1029899833,58cyclictest14901-21cat05:15:122
1029799834,72cyclictest0-21swapper/107:46:451
1029799833,73cyclictest0-21swapper/108:21:571
1029799833,73cyclictest0-21swapper/108:00:111
1029799833,73cyclictest0-21swapper/108:00:111
1029899824,71cyclictest0-21swapper/206:45:112
1029899824,71cyclictest0-21swapper/206:45:112
1029899824,71cyclictest0-21swapper/206:10:022
1029799824,71cyclictest0-21swapper/107:35:301
1029799824,70cyclictest0-21swapper/110:10:281
1029799824,70cyclictest0-21swapper/110:10:281
1029799824,70cyclictest0-21swapper/107:39:521
1029799823,73cyclictest8235-21df_abs06:10:001
1029799823,73cyclictest13239-21taskset05:11:041
1029799823,73cyclictest0-21swapper/107:59:391
1029799823,73cyclictest0-21swapper/106:29:261
1029799823,72cyclictest5506-21latency10:20:001
1029799823,72cyclictest0-21swapper/110:02:061
1029799823,72cyclictest0-21swapper/108:09:371
1029799823,71cyclictest2028-21df_inode08:39:551
1029799823,71cyclictest2028-21df_inode08:39:551
248599810,4rtkit-daemon2484-21rtkit-daemon09:12:503
1029899813,65cyclictest30766-21threads06:55:152
1029899812,72cyclictest0-21swapper/207:22:522
1029799814,70cyclictest0-21swapper/108:57:261
1029799814,69cyclictest0-21swapper/106:15:141
1029799812,71cyclictest25698-21munin-node05:40:051
1029899804,69cyclictest4195-21ssh07:07:352
1029899804,69cyclictest0-21swapper/206:40:022
1029899804,69cyclictest0-21swapper/206:14:592
1029899804,63cyclictest0-21swapper/206:39:432
1029899803,41cyclictest18306-21crond05:29:412
1029799803,70cyclictest556-21aten_r1power_vo05:54:591
1029799803,70cyclictest0-21swapper/109:24:511
1029799803,70cyclictest0-21swapper/109:24:511
1029799803,70cyclictest0-21swapper/106:59:571
1029799803,70cyclictest0-21swapper/106:33:551
1029799803,43cyclictest0-21swapper/110:27:411
75432790,3sleep041ktimersoftd/008:47:530
75432790,3sleep041ktimersoftd/008:47:530
1029899793,69cyclictest17072-21latency_hist06:29:442
1029899793,63cyclictest0-21swapper/205:33:302
1029799794,68cyclictest0-21swapper/105:15:001
1029799794,67cyclictest0-21swapper/106:04:451
1029799794,67cyclictest0-21swapper/106:04:451
1029799794,57cyclictest0-21swapper/106:54:551
1029899787,55cyclictest0-21swapper/206:59:592
1029899784,59cyclictest0-21swapper/206:19:572
1029899784,56cyclictest0-21swapper/206:05:192
1029899784,56cyclictest0-21swapper/206:05:192
1029799784,67cyclictest0-21swapper/106:50:051
1029799783,69cyclictest0-21swapper/106:05:131
1029799783,69cyclictest0-21swapper/106:05:131
1029799783,68cyclictest1676-21nscd05:49:451
1029799782,69cyclictest0-21swapper/106:44:451
248599770,4rtkit-daemon2484-21rtkit-daemon09:37:573
1029799774,58cyclictest0-21swapper/106:45:011
1029799774,58cyclictest0-21swapper/106:45:011
1029799773,68cyclictest0-21swapper/108:25:491
1029799773,68cyclictest0-21swapper/106:20:171
1029799773,58cyclictest23314-21munin-node05:35:011
1029899764,59cyclictest0-21swapper/205:48:332
1029899753,65cyclictest0-21swapper/206:00:072
1029899753,65cyclictest0-21swapper/206:00:072
1029799754,64cyclictest0-21swapper/105:26:491
1029899744,56cyclictest0-21swapper/205:55:092
1029899732,59cyclictest0-21swapper/205:23:282
1029899732,59cyclictest0-21swapper/205:23:282
1029799735,45cyclictest0-21swapper/105:33:281
1029799733,63cyclictest0-21swapper/105:19:591
1029799733,63cyclictest0-21swapper/105:19:591
91632728,52sleep20-21swapper/205:00:102
1029799723,63cyclictest0-21swapper/105:06:291
1029799723,61cyclictest0-21swapper/106:39:071
1029799694,42cyclictest0-21swapper/105:04:481
248599680,6rtkit-daemon0-21swapper/307:14:030
248599680,5rtkit-daemon20302-21ntp_states07:30:093
1029899684,43cyclictest0-21swapper/205:04:592
1029899684,41cyclictest0-21swapper/205:10:012
248599670,8rtkit-daemon0-21swapper/308:23:303
1029999674,12cyclictest0-21swapper/307:45:163
248599660,8rtkit-daemon0-21swapper/309:19:433
248599660,5rtkit-daemon2484-21rtkit-daemon05:40:210
248599660,5rtkit-daemon2484-21rtkit-daemon05:38:060
248599660,4rtkit-daemon2484-21rtkit-daemon06:07:500
248599660,4rtkit-daemon2484-21rtkit-daemon06:07:500
248599650,7rtkit-daemon0-21swapper/308:57:063
248599650,6rtkit-daemon0-21swapper/308:02:533
248599650,6rtkit-daemon0-21swapper/308:02:533
248599640,7rtkit-daemon0-21swapper/307:05:033
248599620,8rtkit-daemon0-21swapper/005:15:150
248599620,6rtkit-daemon0-21swapper/209:19:353
248599620,6rtkit-daemon0-21swapper/007:25:550
248599620,6rtkit-daemon0-21swapper/007:25:550
158942627,48sleep00-21swapper/008:11:300
1029399614,48cyclictest0-21swapper/010:14:500
1029399605,46cyclictest0-21swapper/009:24:340
1029999594,37cyclictest0-21swapper/307:49:523
10293995920,30cyclictest0-21swapper/007:34:420
1029999584,14cyclictest0-21swapper/309:53:293
1029999584,13cyclictest0-21swapper/310:15:023
1029999584,12cyclictest0-21swapper/309:45:123
1029999584,12cyclictest0-21swapper/306:50:203
1029999583,12cyclictest0-21swapper/310:24:513
10299995823,27cyclictest1419-21runrttasks08:25:103
10293995840,12cyclictest0-21swapper/009:30:100
1029399584,34cyclictest0-21swapper/005:30:100
1029999574,13cyclictest0-21swapper/307:21:473
1029999574,12cyclictest0-21swapper/306:44:433
10299995739,11cyclictest24197-21gltestperf05:35:053
10299995715,26cyclictest1828-21cstates08:39:533
10299995715,26cyclictest1828-21cstates08:39:533
1029399574,45cyclictest0-21swapper/007:45:000
10293995736,15cyclictest0-21swapper/008:49:490
10293995734,15cyclictest0-21swapper/006:49:560
1029399573,46cyclictest1128-21crond08:44:380
1029399573,46cyclictest1128-21crond08:44:380
10293995714,35cyclictest20284-21kworker/u8:005:49:570
1029999565,15cyclictest0-21swapper/309:41:413
1029999564,12cyclictest0-21swapper/307:38:353
1029999563,44cyclictest8566-21cpuspeed_turbos08:49:513
10293995637,13cyclictest0-21swapper/007:59:540
10293995637,13cyclictest0-21swapper/007:59:540
19672553,45sleep00-21swapper/009:27:290
19672553,45sleep00-21swapper/009:27:290
1029999554,32cyclictest0-21swapper/308:30:113
1029999554,31cyclictest0-21swapper/308:05:053
10299995538,10cyclictest14910-21needreboot08:10:063
10293995539,10cyclictest0-21swapper/008:21:350
10293995535,13cyclictest0-21swapper/009:00:040
10293995534,14cyclictest0-21swapper/006:39:580
24632542,11sleep00-21swapper/005:56:330
227742542,10sleep30-21swapper/305:30:523
109712542,44sleep00-21swapper/005:07:360
1029999545,15cyclictest0-21swapper/309:29:003
1029999545,15cyclictest0-21swapper/309:29:003
10299995424,11cyclictest32216-21unixbench-2d08:35:133
1029999542,23cyclictest0-21swapper/309:54:503
10293995439,9cyclictest0-21swapper/009:41:090
1029399543,46cyclictest0-21swapper/006:25:180
10293995426,12cyclictest0-21swapper/010:00:010
10293995420,13cyclictest0-21swapper/010:24:480
211012533,44sleep321105-21sh09:08:093
1029999534,30cyclictest0-21swapper/305:50:093
1029999534,29cyclictest0-21swapper/307:40:143
1029999534,28cyclictest0-21swapper/305:49:463
10299995336,10cyclictest17384-21cpuspeed_turbos08:14:543
10299995333,13cyclictest17209-21kernelversion05:20:113
10299995333,13cyclictest17209-21kernelversion05:20:113
10299995312,10cyclictest0-21swapper/307:15:023
1029399535,14cyclictest32419-21yum-updatesd-he07:50:050
1029399535,14cyclictest0-21swapper/007:40:230
1029399534,41cyclictest0-21swapper/008:04:510
1029399534,40cyclictest26709-21head10:04:480
10293995332,13cyclictest0-21swapper/008:15:010
10293995332,12cyclictest1419-21runrttasks09:12:020
10293995331,14cyclictest0-21swapper/010:10:040
10293995331,14cyclictest0-21swapper/010:10:040
10293995323,25cyclictest0-21swapper/009:58:250
1029999524,29cyclictest0-21swapper/310:14:363
1029999524,29cyclictest0-21swapper/310:14:363
1029999524,29cyclictest0-21swapper/306:54:593
1029999524,14cyclictest0-21swapper/309:32:253
10299995234,11cyclictest10452-21tr06:15:003
10299995220,13cyclictest0-21swapper/307:24:563
10299995220,13cyclictest0-21swapper/307:24:563
1029399526,28cyclictest0-21swapper/007:20:010
1029399524,13cyclictest0-21swapper/010:33:370
10293995234,12cyclictest0-21swapper/006:35:130
10293995231,14cyclictest0-21swapper/006:31:190
10293995210,33cyclictest0-21swapper/007:15:060
49672512,10sleep30-21swapper/310:19:533
267292513,39sleep326826-21memory05:40:123
24622513,41sleep02571-21grep07:05:020
1029999514,31cyclictest0-21swapper/307:59:243
1029999514,30cyclictest0-21swapper/305:10:093
1029999514,29cyclictest0-21swapper/308:48:053
1029999514,29cyclictest0-21swapper/308:48:053
1029999514,29cyclictest0-21swapper/307:09:543
1029999514,29cyclictest0-21swapper/306:45:163
1029999514,29cyclictest0-21swapper/306:45:163
1029999514,29cyclictest0-21swapper/306:20:173
1029999514,28cyclictest0-21swapper/308:59:583
1029999514,27cyclictest0-21swapper/305:55:163
1029999514,26cyclictest12162-21iostat_ios10:29:593
10299995120,14cyclictest0-21swapper/305:06:203
1029399514,41cyclictest18311-21latency_hist05:24:470
1029399514,41cyclictest18311-21latency_hist05:24:470
1029399514,40cyclictest0-21swapper/009:38:070
10293995130,13cyclictest14413-21taskset06:21:200
10293995129,15cyclictest0-21swapper/008:55:080
50732502,9sleep30-21swapper/306:04:063
50732502,9sleep30-21swapper/306:04:063
1029999505,26cyclictest0-21swapper/310:08:293
1029999504,29cyclictest0-21swapper/309:59:573
1029999504,29cyclictest0-21swapper/306:10:103
1029999504,27cyclictest0-21swapper/305:29:473
1029399504,27cyclictest0-21swapper/007:54:590
1029399504,25cyclictest0-21swapper/006:54:560
10122502,42sleep00-21swapper/007:00:260
10299994918,13cyclictest0-21swapper/307:00:093
1029399495,27cyclictest0-21swapper/005:28:290
1029399494,30cyclictest0-21swapper/005:10:130
1029399494,28cyclictest0-21swapper/006:00:030
1029399494,28cyclictest0-21swapper/006:00:030
98292483,38sleep00-21swapper/006:13:540
1029399483,40cyclictest0-21swapper/005:46:230
10293994820,11cyclictest0-21swapper/006:45:110
10293994820,11cyclictest0-21swapper/006:45:110
1029999476,25cyclictest0-21swapper/306:35:053
1029999474,26cyclictest0-21swapper/306:25:053
10299994730,10cyclictest15466-21unixbench_multi05:15:213
10299994618,12cyclictest0-21swapper/306:31:413
1029399463,35cyclictest0-21swapper/006:15:140
101012464,36sleep00-21swapper/005:02:410
83782444,33sleep30-21swapper/305:00:033
1029999444,12cyclictest0-21swapper/306:08:363
1029999444,12cyclictest0-21swapper/306:08:363
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional