You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 00:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Mon May 11, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6264991034,26cyclictest0-21swapper/109:08:241
626499964,24cyclictest0-21swapper/107:54:561
626499949,61cyclictest0-21swapper/106:50:131
626499944,83cyclictest0-21swapper/109:04:031
626499929,18cyclictest30644-21cstates07:34:541
6264999232,52cyclictest9430-21cpuspeed_turbos10:14:481
626499915,66cyclictest20844-21fschecks_time07:19:571
626499905,63cyclictest0-21swapper/108:00:121
626499904,24cyclictest0-21swapper/110:00:221
626499904,24cyclictest0-21swapper/108:16:381
626499904,24cyclictest0-21swapper/107:18:281
626499904,24cyclictest0-21swapper/107:13:361
626499904,23cyclictest10289-21rm09:27:571
115992900,3sleep041ktimersoftd/005:00:000
626499895,23cyclictest0-21swapper/109:11:411
626499894,27cyclictest0-21swapper/109:29:521
626499894,27cyclictest0-21swapper/109:29:521
626499894,25cyclictest0-21swapper/110:05:201
626499894,23cyclictest0-21swapper/109:35:571
626499894,23cyclictest0-21swapper/109:16:041
6264998921,11cyclictest0-21swapper/108:30:211
6264998920,14cyclictest0-21swapper/105:05:101
6264998919,12cyclictest0-21swapper/108:24:511
6264998916,12cyclictest0-21swapper/107:50:501
626499885,66cyclictest0-21swapper/106:59:421
626499885,24cyclictest0-21swapper/110:11:141
626499885,24cyclictest0-21swapper/110:11:141
626499884,26cyclictest0-21swapper/106:54:561
626499884,25cyclictest0-21swapper/108:19:491
626499884,23cyclictest26021-21ssh09:50:051
626499884,22cyclictest0-21swapper/108:54:521
626499884,21cyclictest6497-21expr08:34:521
6264998816,11cyclictest30378-21ssh09:57:211
626499875,27cyclictest0-21swapper/109:20:591
626499875,27cyclictest0-21swapper/106:16:191
626499874,23cyclictest0-21swapper/108:05:031
626499874,23cyclictest0-21swapper/108:05:031
626499874,23cyclictest0-21swapper/107:49:241
626499874,20cyclictest26939-21ssh07:29:521
626499873,20cyclictest22926-21ntp_offset08:10:051
626499864,26cyclictest0-21swapper/107:40:481
626499864,22cyclictest0-21swapper/107:24:581
626499863,27cyclictest0-21swapper/109:44:541
6264998620,12cyclictest0-21swapper/108:45:061
626499856,18cyclictest0-21swapper/106:39:421
626499855,22cyclictest0-21swapper/108:54:141
626499855,22cyclictest0-21swapper/108:54:141
626499854,29cyclictest0-21swapper/106:05:091
626499854,29cyclictest0-21swapper/106:05:091
626499854,25cyclictest0-21swapper/108:44:361
626499854,24cyclictest0-21swapper/109:42:181
6264998526,50cyclictest10616-21gltestperf07:05:001
626499845,28cyclictest0-21swapper/106:09:541
626499844,72cyclictest30104-21crond05:39:441
626499844,70cyclictest0-21swapper/105:15:031
626499844,28cyclictest0-21swapper/105:30:091
626499844,25cyclictest0-21swapper/105:53:051
626499843,28cyclictest0-21swapper/106:29:521
6264998429,49cyclictest23135-21sshd05:24:451
6264998429,49cyclictest23135-21sshd05:24:451
6264998414,14cyclictest0-21swapper/105:39:551
626299837,59cyclictest14866-21munin-node08:00:070
626299834,61cyclictest0-21swapper/009:14:470
626299833,63cyclictest0-21swapper/008:14:560
626499824,72cyclictest9464-21cut04:55:021
626499824,55cyclictest0-21swapper/106:29:411
626499824,27cyclictest0-21swapper/105:55:171
6264998220,13cyclictest0-21swapper/105:45:041
626299825,70cyclictest5500-21ssh06:58:160
626299825,70cyclictest0-21swapper/006:25:110
6262998230,46cyclictest0-21swapper/009:58:590
626299815,37cyclictest0-21swapper/009:06:370
626299805,46cyclictest0-21swapper/007:45:010
626299804,69cyclictest0-21swapper/009:34:580
6262998010,54cyclictest0-21swapper/010:05:100
626499795,61cyclictest0-21swapper/104:50:181
6264997925,47cyclictest7794-21cpu05:59:551
6264997924,48cyclictest12591-21proc_pri05:00:141
626299794,49cyclictest0-21swapper/008:20:000
626299793,69cyclictest14107-21ssh08:45:020
626299793,68cyclictest31580-21ssh07:35:080
626299793,57cyclictest5205-21hwlatdetect09:19:560
6262997921,35cyclictest13494-21ssh07:55:400
6262997910,55cyclictest0-21swapper/006:54:400
6264997820,7cyclictest17350-21proc_pri05:10:131
6264997818,10cyclictest27171-21df_abs06:39:561
6264997811,13cyclictest0-21swapper/106:19:541
626299788,54cyclictest0-21swapper/009:32:070
626299788,54cyclictest0-21swapper/009:32:070
626299786,56cyclictest17140-21tail08:49:560
626299786,56cyclictest17140-21tail08:49:560
626299785,67cyclictest0-21swapper/008:11:280
626299785,54cyclictest0-21swapper/007:14:510
6262997833,40cyclictest20044-21timerwakeupswit05:15:170
626299783,69cyclictest0-21swapper/005:50:010
626299783,67cyclictest24407-21grep07:24:580
6262997828,29cyclictest22446-21ssh07:21:490
6262997821,41cyclictest245211munin-node09:49:500
6262997816,46cyclictest0-21swapper/007:10:430
626499773,18cyclictest29252-21runrttasks06:44:541
626499773,18cyclictest29252-21runrttasks06:44:541
626299776,53cyclictest0-21swapper/007:30:110
626299775,65cyclictest0-21swapper/009:47:300
626299775,65cyclictest0-21swapper/008:28:340
626299774,66cyclictest0-21swapper/009:09:540
626299772,69cyclictest0-21swapper/009:00:400
6262997712,60cyclictest11524-21unixbench-2d07:05:140
626299766,52cyclictest0-21swapper/006:29:530
626299765,64cyclictest0-21swapper/006:11:180
626299764,51cyclictest0-21swapper/005:10:110
6262997631,40cyclictest15613-21gltestperf06:15:010
626299763,57cyclictest0-21swapper/009:44:050
626299763,56cyclictest0-21swapper/005:09:440
6262997622,39cyclictest1247-21lldpd05:23:180
6262997622,39cyclictest1247-21lldpd05:23:180
6262997610,46cyclictest279561munin-node05:35:150
626299756,62cyclictest19725-21mailstats08:05:080
626299756,62cyclictest19725-21mailstats08:05:080
626299755,64cyclictest0-21swapper/010:19:300
626299755,63cyclictest0-21swapper/010:11:430
626299755,63cyclictest0-21swapper/010:11:430
626299755,63cyclictest0-21swapper/007:40:380
626299754,52cyclictest0-21swapper/008:55:020
626299754,51cyclictest0-21swapper/006:59:450
626299753,66cyclictest0-21swapper/006:19:540
626299753,64cyclictest69341rm08:34:570
6262997510,49cyclictest0-21swapper/009:29:220
626299746,62cyclictest0-21swapper/008:43:150
626299745,38cyclictest0-21swapper/010:01:520
626299743,63cyclictest4746-21rm08:30:320
6262997428,40cyclictest24954-21grep05:25:180
626499733,22cyclictest0-21swapper/105:24:561
6262997329,38cyclictest29786-21fschecks_count06:44:590
6262997329,38cyclictest29786-21fschecks_count06:44:590
6262997314,44cyclictest0-21swapper/007:52:220
626299726,59cyclictest0-21swapper/005:59:570
626299715,58cyclictest0-21swapper/005:54:540
626299704,60cyclictest0-21swapper/006:41:080
626299695,53cyclictest0-21swapper/004:49:460
626299694,58cyclictest25601-21telnet05:29:550
626299693,61cyclictest0-21swapper/005:45:050
626299692,60cyclictest8474-21chrt04:52:460
6262996914,34cyclictest24399-21kworker/0:106:34:540
6262996813,39cyclictest8864-21munin-node04:55:090
626299674,37cyclictest0-21swapper/005:40:160
626299664,55cyclictest106042sleep006:05:000
626299664,55cyclictest106042sleep006:05:000
6264996515,8cyclictest0-21swapper/104:49:461
626699628,46cyclictest0-21swapper/309:49:503
248599620,4rtkit-daemon2484-21rtkit-daemon08:46:453
626599594,48cyclictest0-21swapper/206:50:342
6266995832,12cyclictest0-21swapper/309:29:403
6266995832,12cyclictest0-21swapper/309:29:403
6266995831,12cyclictest0-21swapper/308:59:593
49972584,14sleep20-21swapper/205:54:432
626699573,38cyclictest0-21swapper/307:03:163
6266995721,9cyclictest0-21swapper/308:29:583
626599575,44cyclictest0-21swapper/208:50:002
626599575,44cyclictest0-21swapper/208:50:002
626599575,16cyclictest0-21swapper/209:04:382
626599574,46cyclictest0-21swapper/209:24:502
626599574,46cyclictest0-21swapper/207:30:132
58712572,10sleep20-21swapper/206:59:282
305802573,13sleep20-21swapper/209:09:542
248599570,6rtkit-daemon2484-21rtkit-daemon09:35:363
248599570,5rtkit-daemon2484-21rtkit-daemon08:35:313
96962564,45sleep20-21swapper/210:14:522
626699564,46cyclictest0-21swapper/309:58:423
6266995631,12cyclictest0-21swapper/309:28:253
6266995631,12cyclictest0-21swapper/307:27:543
6266995630,12cyclictest0-21swapper/308:40:333
6266995630,12cyclictest0-21swapper/306:49:363
6266995630,12cyclictest0-21swapper/306:49:363
626599565,45cyclictest0-21swapper/207:15:152
626599563,47cyclictest0-21swapper/208:08:032
626599563,47cyclictest0-21swapper/208:08:032
6265995614,11cyclictest23936-21grep08:59:552
6265995610,31cyclictest20938-21fschecks_time07:19:572
6266995529,12cyclictest0-21swapper/309:07:413
626599554,44cyclictest0-21swapper/209:29:492
626599554,44cyclictest0-21swapper/209:29:492
626599554,44cyclictest0-21swapper/207:59:542
626599554,43cyclictest1967-21cut07:39:582
626599553,45cyclictest0-21swapper/206:19:562
248599550,5rtkit-daemon2484-21rtkit-daemon08:50:083
248599550,5rtkit-daemon2484-21rtkit-daemon08:50:083
626699543,45cyclictest0-21swapper/307:38:323
6266995429,12cyclictest0-21swapper/308:13:213
6266995423,26cyclictest0-21swapper/310:09:503
6266995423,26cyclictest0-21swapper/310:09:503
626599545,42cyclictest0-21swapper/209:20:102
626599544,43cyclictest0-21swapper/208:20:022
626599543,45cyclictest0-21swapper/206:13:082
626599543,13cyclictest0-21swapper/209:15:092
248599540,6rtkit-daemon2484-21rtkit-daemon09:37:432
248599540,5rtkit-daemon2484-21rtkit-daemon10:00:053
248599540,5rtkit-daemon2484-21rtkit-daemon09:44:513
248599540,5rtkit-daemon2484-21rtkit-daemon07:54:553
626599535,42cyclictest0-21swapper/208:25:062
6265995337,10cyclictest12370-21grep07:54:572
626599533,44cyclictest0-21swapper/207:53:142
626599533,43cyclictest0-21swapper/207:25:002
45222532,11sleep30-21swapper/310:06:143
248599530,5rtkit-daemon2484-21rtkit-daemon08:58:453
248599530,5rtkit-daemon2484-21rtkit-daemon07:06:193
248599530,4rtkit-daemon2484-21rtkit-daemon07:43:253
248599530,12rtkit-daemon2484-21rtkit-daemon07:45:103
6266995230,8cyclictest12275-21ssh10:19:333
626699523,42cyclictest0-21swapper/309:39:473
626599525,30cyclictest0-21swapper/209:49:592
626599524,42cyclictest0-21swapper/208:56:022
626599524,42cyclictest0-21swapper/208:44:222
626599524,42cyclictest0-21swapper/207:35:322
626599524,41cyclictest11643-21taskset07:05:152
626599524,41cyclictest0-21swapper/209:55:072
626599523,44cyclictest0-21swapper/208:34:082
626599523,44cyclictest0-21swapper/207:10:032
6265995210,12cyclictest0-21swapper/210:04:522
54392523,13sleep20-21swapper/207:44:582
38752523,42sleep33949-21needreboot06:55:053
271072523,42sleep20-21swapper/208:16:102
248599520,6rtkit-daemon2484-21rtkit-daemon08:00:023
248599520,5rtkit-daemon2484-21rtkit-daemon08:05:323
248599520,5rtkit-daemon2484-21rtkit-daemon08:05:323
103422522,9sleep30-21swapper/307:51:283
626699513,22cyclictest0-21swapper/307:29:523
626599517,37cyclictest18907-21wc09:40:002
626599514,42cyclictest0-21swapper/209:47:132
6265995121,11cyclictest0-21swapper/208:44:482
626599512,43cyclictest0-21swapper/210:10:422
626599512,43cyclictest0-21swapper/210:10:422
6265995114,32cyclictest1419-21runrttasks08:12:122
257972512,10sleep30-21swapper/308:14:583
25332512,9sleep30-21swapper/305:48:523
248599510,5rtkit-daemon2484-21rtkit-daemon08:24:093
248599510,12rtkit-daemon2484-21rtkit-daemon09:14:593
6265995030,14cyclictest0-21swapper/205:15:172
6265995012,32cyclictest6236-21munin-node06:59:522
273882502,40sleep30-21swapper/305:30:263
83382492,9sleep30-21swapper/304:51:013
6266994928,9cyclictest0-21swapper/307:20:003
626599494,30cyclictest0-21swapper/206:43:132
626599493,41cyclictest0-21swapper/208:35:072
6265994921,11cyclictest0-21swapper/205:20:002
6265994921,11cyclictest0-21swapper/205:20:002
214902492,9sleep30-21swapper/306:26:523
180882492,9sleep30-21swapper/305:13:383
6266994826,18cyclictest0-21swapper/306:40:143
6266994821,21cyclictest0-21swapper/306:35:403
626599483,40cyclictest0-21swapper/209:59:512
626599483,21cyclictest0-21swapper/205:55:142
626699473,37cyclictest0-21swapper/309:09:493
626599474,28cyclictest0-21swapper/204:54:562
626599474,12cyclictest0-21swapper/206:49:412
626599474,12cyclictest0-21swapper/206:49:412
626599472,40cyclictest0-21swapper/205:10:182
248599470,5rtkit-daemon2484-21rtkit-daemon07:15:273
120582472,9sleep30-21swapper/306:08:223
120582472,9sleep30-21swapper/306:08:223
119952472,9sleep20-21swapper/206:07:332
119952472,9sleep20-21swapper/206:07:332
6266994620,21cyclictest16096-21open_inodes06:15:093
6266994619,9cyclictest5773-21python09:20:073
6266994618,9cyclictest19452-21cat06:24:423
6266994615,13cyclictest0-21swapper/306:14:423
626599464,27cyclictest0-21swapper/205:25:172
6265994619,11cyclictest0-21swapper/205:05:062
215412462,10sleep20-21swapper/206:27:322
78452453,34sleep30-21swapper/305:59:563
6266994531,9cyclictest14123-21tail07:09:593
626699453,36cyclictest0-21swapper/308:25:003
626699453,27cyclictest0-21swapper/305:07:253
6266994528,12cyclictest0-21swapper/306:50:153
626599459,30cyclictest0-21swapper/205:00:122
626599454,34cyclictest0-21swapper/205:59:532
626599454,28cyclictest0-21swapper/205:35:152
626599454,26cyclictest0-21swapper/204:49:592
626599454,25cyclictest0-21swapper/206:38:122
61582454,34sleep20-21swapper/204:48:552
250822452,37sleep30-21swapper/305:26:313
166012452,9sleep20-21swapper/206:15:192
6266994431,8cyclictest19615-21tail05:15:083
626699443,35cyclictest0-21swapper/304:55:003
626599446,32cyclictest0-21swapper/205:44:552
6265994430,9cyclictest26190-21grep05:30:022
626599443,24cyclictest0-21swapper/206:29:522
48302442,35sleep30-21swapper/305:52:353
6266994328,10cyclictest32024-21grep05:40:163
6266994316,9cyclictest30194-21cat05:39:453
626599435,33cyclictest0-21swapper/205:39:562
626699424,33cyclictest0-21swapper/305:54:513
626699424,13cyclictest0-21swapper/305:00:033
626699413,32cyclictest0-21swapper/306:34:423
6266994128,8cyclictest20958-21aten_r1power_vo05:19:583
6266994128,8cyclictest20958-21aten_r1power_vo05:19:583
626699334,24cyclictest0-21swapper/304:49:463
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional