You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-26 - 15:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Thu Mar 26, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31721240,4sleep1319-21uname10:38:091
104049910222,72cyclictest30314-21switchtime08:58:191
104049910222,72cyclictest30314-21switchtime08:58:191
1040499984,35cyclictest0-21swapper/107:04:001
10404999716,8cyclictest31074-21runrttasks09:48:071
10399999718,12cyclictest0-21swapper/007:47:590
1040499963,85cyclictest26751-21munin-node09:42:561
1040499963,85cyclictest26751-21munin-node09:42:561
1040499934,83cyclictest9368-21munin-node06:38:231
1040499934,82cyclictest7816-21interrupts07:38:141
1040499934,36cyclictest0-21swapper/110:46:181
1040499933,84cyclictest16571-21telnet06:53:041
1040499933,84cyclictest16571-21telnet06:53:041
1039999933,22cyclictest28339-21ssh08:57:140
10399999317,7cyclictest19237-21ssh10:18:080
1040499924,33cyclictest1419-21runrttasks06:44:391
1040499924,33cyclictest0-21swapper/108:01:391
1040499923,22cyclictest3131-21diskmemload08:28:241
10404999219,12cyclictest0-21swapper/107:51:591
10404999215,11cyclictest0-21swapper/108:21:151
1039999923,38cyclictest0-21swapper/007:46:040
1039999923,24cyclictest14505-21munin-node10:58:160
1039999923,20cyclictest18820-21ssh07:53:230
1039999922,22cyclictest15948-21ssh09:26:060
10399999214,10cyclictest1287-21snmpd08:23:060
1040499914,35cyclictest18834-21fschecks_time10:18:021
1040499914,23cyclictest1103-21yum-updatesd-he08:16:481
1040499913,81cyclictest3131-21diskmemload08:05:591
1039999914,22cyclictest10232-21tr09:18:000
1039999913,82cyclictest0-21swapper/008:20:180
1039999913,81cyclictest0-21swapper/008:47:580
1039999913,22cyclictest3131-21diskmemload10:53:120
1039999913,19cyclictest4629-21ssh09:08:170
1039999913,11cyclictest0-21swapper/009:49:280
10399999119,8cyclictest1419-21runrttasks09:00:090
10399999119,8cyclictest1419-21runrttasks09:00:090
10399999117,7cyclictest28577-21ssh08:08:150
10399999116,8cyclictest3131-21diskmemload08:38:130
1040699904,42cyclictest0-21swapper/208:53:182
1040499904,21cyclictest1287-21snmpd10:57:381
1039999903,22cyclictest10268-21kworker/0:108:13:150
10399999018,10cyclictest4702-21aten2.4-expect09:57:570
10399999014,13cyclictest0-21swapper/009:42:460
10399999014,13cyclictest0-21swapper/009:42:460
1040699894,78cyclictest0-21swapper/208:18:022
1040499895,76cyclictest19773-21ssh09:32:461
1040499894,78cyclictest3131-21diskmemload10:50:221
1040499894,37cyclictest0-21swapper/110:17:181
1040499894,36cyclictest0-21swapper/108:47:071
1040499894,36cyclictest0-21swapper/107:53:121
1040499893,79cyclictest7041-21ssh08:23:221
1039999894,79cyclictest3131-21diskmemload08:43:050
1039999893,8cyclictest121850irq/46-eth009:56:240
1039999893,24cyclictest0-21swapper/008:37:150
1039999893,20cyclictest9158-21ssh08:28:050
1039999893,13cyclictest0-21swapper/009:17:460
10399998916,11cyclictest0-21swapper/010:16:160
10399998913,11cyclictest0-21swapper/009:03:190
10399998913,10cyclictest0-21swapper/009:31:380
1040499885,33cyclictest0-21swapper/110:23:361
1040499885,33cyclictest0-21swapper/110:23:361
1040499885,24cyclictest0-21swapper/107:33:221
1040499885,24cyclictest0-21swapper/107:33:221
1040499884,34cyclictest0-21swapper/108:32:561
1040499883,77cyclictest3131-21diskmemload09:25:331
1040499883,38cyclictest0-21swapper/108:38:251
1040499883,37cyclictest0-21swapper/110:10:421
1040499883,37cyclictest0-21swapper/109:15:061
1039999884,21cyclictest3131-21diskmemload10:33:590
1039999883,25cyclictest0-21swapper/009:33:120
1039999883,22cyclictest2027-21ssh10:42:030
1039999883,12cyclictest0-21swapper/010:12:320
1039999882,23cyclictest32093-21munin-node06:18:060
10399998815,11cyclictest0-21swapper/010:48:150
10399998815,11cyclictest0-21swapper/007:38:160
10399998814,7cyclictest4423-21rm07:33:120
10399998814,7cyclictest4423-21rm07:33:120
10399998813,12cyclictest0-21swapper/010:26:200
10399998813,12cyclictest0-21swapper/010:26:200
10407998734,17cyclictest19256-21sshd09:30:543
1040699873,75cyclictest0-21swapper/210:47:152
1040699873,62cyclictest0-21swapper/210:38:352
1040499875,24cyclictest0-21swapper/109:06:311
1040499874,76cyclictest0-21swapper/108:53:081
1040499873,38cyclictest14562-21users10:58:171
1040499873,37cyclictest30321-21ssh10:34:191
10404998716,11cyclictest0-21swapper/109:53:021
1039999873,21cyclictest3131-21diskmemload09:44:300
1039999873,21cyclictest3131-21diskmemload09:44:300
1039999873,21cyclictest24929-21ssh08:03:110
1039999873,20cyclictest2696-21ssh10:42:540
1039999872,77cyclictest1287-21snmpd07:25:500
10407998639,40cyclictest6087-21fgrep09:58:143
1040699865,74cyclictest0-21swapper/208:11:242
10404998635,10cyclictest23124-21crond09:37:461
1040499863,76cyclictest3298-21cat07:32:521
1040499863,40cyclictest22433-21seq08:48:021
1039999867,10cyclictest0-21swapper/010:02:580
1039999864,28cyclictest0-21swapper/006:38:200
1039999863,32cyclictest27920-21grep06:08:120
1039999863,25cyclictest12778-21munin-run05:37:560
10399998627,13cyclictest0-21swapper/006:16:550
10399998623,9cyclictest1419-21runrttasks07:15:270
1039999862,22cyclictest3131-21diskmemload10:29:320
1040699854,76cyclictest0-21swapper/209:28:142
1040699853,74cyclictest0-21swapper/210:21:362
1040699853,51cyclictest26616-21unixbench_singl10:28:172
1040499854,37cyclictest7190-21sshd10:00:521
1040499854,34cyclictest0-21swapper/110:03:051
1040499853,36cyclictest28062-21fschecks_count08:08:091
1040499853,36cyclictest25397-21ssh10:28:001
10404998519,11cyclictest0-21swapper/109:39:321
10404998519,11cyclictest0-21swapper/109:39:321
1039999854,35cyclictest0-21swapper/006:52:530
1039999854,35cyclictest0-21swapper/006:52:530
1039999853,29cyclictest22502-21grep07:58:220
1039999853,27cyclictest0-21swapper/006:28:170
1039999852,25cyclictest1287-21snmpd05:43:060
10399998517,12cyclictest0-21swapper/006:53:070
10399998517,12cyclictest0-21swapper/006:53:070
10407998437,40cyclictest20077-21aten_r1power_cu09:32:573
10407998430,47cyclictest0-21swapper/309:15:003
1040699844,74cyclictest0-21swapper/210:08:082
1040699844,74cyclictest0-21swapper/209:52:572
1040699844,65cyclictest0-21swapper/207:58:132
1040699843,74cyclictest0-21swapper/209:37:532
1040699843,74cyclictest0-21swapper/209:37:532
1040699843,74cyclictest0-21swapper/208:44:472
1040699843,73cyclictest2083-21munin-node06:23:042
1040699843,46cyclictest8435-21munin-node07:38:252
1040499845,72cyclictest0-21swapper/106:48:281
1040499845,72cyclictest0-21swapper/106:48:281
1040499845,27cyclictest0-21swapper/107:26:471
1040499844,30cyclictest4879-21timerandwakeup09:08:201
1040499843,40cyclictest1902-21cat06:22:551
1040499843,39cyclictest1287-21snmpd05:45:341
1040499843,39cyclictest1287-21snmpd05:35:321
1040499843,37cyclictest0-21swapper/107:47:511
1040499843,23cyclictest11452-21munin-node09:18:171
10407998339,38cyclictest4623-21ps09:08:173
10407998336,41cyclictest25839-21runrttasks09:40:273
10407998336,41cyclictest25839-21runrttasks09:40:273
10407998336,41cyclictest0-21swapper/308:33:053
10407998334,43cyclictest18384-21grep05:48:123
10407998331,46cyclictest0-21swapper/309:57:363
1040699835,73cyclictest0-21swapper/210:58:222
1040699835,72cyclictest0-21swapper/207:34:382
1040699835,72cyclictest0-21swapper/207:34:382
1040699834,73cyclictest0-21swapper/210:02:252
1040699834,73cyclictest0-21swapper/208:48:112
1040699834,73cyclictest0-21swapper/208:23:062
1040699834,72cyclictest13502-21unixbench_singl06:43:262
1040699832,74cyclictest0-21swapper/209:46:052
1040699832,74cyclictest0-21swapper/209:46:052
1040499833,37cyclictest0-21swapper/106:00:361
10404998327,10cyclictest6132-21timerandwakeup06:28:231
1039999833,12cyclictest0-21swapper/006:58:150
10407998237,38cyclictest6285-21runrttasks07:37:093
10407998237,38cyclictest6285-21runrttasks07:37:093
10407998235,41cyclictest0-21swapper/310:47:393
10407998229,45cyclictest0-21swapper/308:28:173
1040699825,71cyclictest0-21swapper/208:03:162
1040699824,73cyclictest0-21swapper/208:37:492
1040699824,72cyclictest0-21swapper/210:16:532
1040699824,72cyclictest0-21swapper/209:01:192
1040699824,72cyclictest0-21swapper/209:01:192
1040699824,72cyclictest0-21swapper/208:29:332
1040699824,45cyclictest0-21swapper/206:58:042
1040699823,69cyclictest7208-21fschecks_count09:13:062
1040699823,62cyclictest0-21swapper/207:55:032
1040699823,45cyclictest9048-21crond10:52:432
1040699822,47cyclictest0-21swapper/208:15:432
1040499824,27cyclictest0-21swapper/105:48:111
1040499824,10cyclictest15186-21latency_hist05:42:551
1039999823,31cyclictest0-21swapper/006:23:080
1039999823,27cyclictest0-21swapper/005:38:300
10399998217,12cyclictest0-21swapper/007:07:530
10407998134,41cyclictest0-21swapper/308:08:243
10407998130,44cyclictest24795-21tune2fs08:03:093
10407998130,43cyclictest0-21swapper/310:50:043
1040699814,72cyclictest0-21swapper/209:11:272
1040699814,69cyclictest11093-21grep07:43:102
1040699812,74cyclictest0-21swapper/210:24:342
1040699812,74cyclictest0-21swapper/210:24:342
1040499813,39cyclictest24273-21diskstats07:08:081
1039999814,69cyclictest0-21swapper/006:03:050
1039999814,69cyclictest0-21swapper/006:03:050
10399998114,12cyclictest0-21swapper/006:43:200
10407998040,33cyclictest1419-21runrttasks06:58:193
10407998039,34cyclictest10137-21taskset07:42:523
10407998035,39cyclictest0-21swapper/308:18:133
10407998033,41cyclictest0-21swapper/307:58:083
10407998029,20cyclictest0-21swapper/310:38:523
1040699805,69cyclictest0-21swapper/210:52:592
1040699804,43cyclictest0-21swapper/205:40:302
10406998022,38cyclictest0-21swapper/210:02:562
1040499805,35cyclictest0-21swapper/105:55:351
1040499804,26cyclictest0-21swapper/106:23:241
1040499803,36cyclictest0-21swapper/106:08:251
1039999803,11cyclictest0-21swapper/005:58:250
10399998016,18cyclictest1419-21runrttasks07:29:050
10407997938,34cyclictest17354-21tail06:53:123
10407997938,34cyclictest17354-21tail06:53:123
10407997937,35cyclictest1838-21crond06:22:543
10407997935,13cyclictest26279-21head08:53:083
10407997934,39cyclictest32729-21df_inode09:03:033
10407997930,44cyclictest0-21swapper/308:38:093
10407997928,44cyclictest8011munin-node07:28:123
1040699798,57cyclictest0-21swapper/209:48:022
1040699794,68cyclictest801-21munin-node07:28:082
1040699793,69cyclictest13569-21cpuspeed_turbos09:23:002
1040699793,68cyclictest0-21swapper/209:07:252
1039999794,26cyclictest0-21swapper/007:20:490
1039999793,12cyclictest0-21swapper/006:33:070
10407997838,33cyclictest27800-21unixbench_multi07:13:253
10407997836,36cyclictest1676-21nscd10:22:443
10407997833,38cyclictest14391-21cat06:48:063
10407997833,38cyclictest14391-21cat06:48:063
10407997831,39cyclictest24854-21munin-node10:27:553
1040699785,58cyclictest0-21swapper/210:33:362
1040699785,57cyclictest0-21swapper/206:50:442
1040699785,57cyclictest0-21swapper/206:50:442
1040699785,41cyclictest0-21swapper/205:43:182
1040699784,70cyclictest0-21swapper/208:39:452
1040699784,68cyclictest0-21swapper/207:48:002
1040699784,67cyclictest0-21swapper/206:54:002
1040699784,67cyclictest0-21swapper/206:54:002
1040499783,35cyclictest0-21swapper/106:33:031
1039999782,34cyclictest0-21swapper/007:08:570
10407997737,32cyclictest6350-21ssh08:23:123
10407997734,37cyclictest17686-21expr07:53:063
10407997733,37cyclictest1419-21runrttasks07:21:573
10407997732,39cyclictest12388-21ssh09:20:293
10407997731,40cyclictest0-21swapper/310:23:563
10407997731,40cyclictest0-21swapper/310:23:563
10407997728,42cyclictest0-21swapper/310:55:063
1040699776,66cyclictest0-21swapper/209:18:232
1040699773,51cyclictest0-21swapper/209:33:042
10407997633,37cyclictest29487-21idleruntime-cro06:12:553
10407997633,37cyclictest29296-21wc10:33:083
10407997632,15cyclictest0-21swapper/311:00:253
10407997631,38cyclictest26812-21aten2.4-expect09:42:573
10407997631,38cyclictest26812-21aten2.4-expect09:42:573
10407997631,37cyclictest13933-21cpu07:48:013
1040699764,44cyclictest0-21swapper/207:08:052
1040699762,45cyclictest0-21swapper/207:23:022
1040499763,33cyclictest27370-21open_files07:13:191
10407997535,33cyclictest4598-21munin-node06:28:053
10407997534,36cyclictest0-21swapper/308:43:003
10407997532,37cyclictest0-21swapper/307:47:523
10407997531,39cyclictest0-21swapper/305:42:553
10407997527,42cyclictest0-21swapper/308:17:243
1040699754,66cyclictest0-21swapper/207:18:192
1040699754,64cyclictest12068-21python05:33:252
1040699754,64cyclictest0-21swapper/206:38:112
1040699753,67cyclictest0-21swapper/206:08:122
1040699753,66cyclictest21909-21awk07:03:082
1040699753,66cyclictest0-21swapper/206:03:062
1040699753,66cyclictest0-21swapper/206:03:062
10404997528,9cyclictest20662-21unixbench_singl06:58:251
10407997433,35cyclictest7972-21munin-node10:02:573
10407997433,34cyclictest22615-21telnet05:58:063
10407997426,43cyclictest0-21swapper/309:22:483
1040699743,66cyclictest0-21swapper/206:19:312
10407997337,15cyclictest23416-21runrttasks07:07:193
10407997333,34cyclictest30297-21munin-node08:58:183
10407997333,34cyclictest30297-21munin-node08:58:183
10407997326,35cyclictest0-21swapper/306:07:553
10407997326,35cyclictest0-21swapper/306:07:553
1040699739,59cyclictest0-21swapper/206:37:542
1040499733,35cyclictest0-21swapper/106:13:171
10407997230,36cyclictest0-21swapper/305:33:073
1040699724,61cyclictest18658-21sed05:48:142
1040699724,61cyclictest0-21swapper/207:13:232
1040499724,34cyclictest0-21swapper/107:18:531
10399997224,12cyclictest0-21swapper/005:53:120
10407997154,11cyclictest24785-21rm08:51:303
10407997134,29cyclictest1419-21runrttasks10:12:483
1040699714,44cyclictest22554-21munin-node05:58:142
10407997033,31cyclictest31155-21python06:13:243
10407997033,31cyclictest13923-21pluginstate06:47:533
10407997030,35cyclictest0-21swapper/310:10:353
10407996938,25cyclictest1419-21runrttasks06:41:193
10407996919,34cyclictest0-21swapper/309:51:133
1040499683,24cyclictest0-21swapper/106:06:161
1040499683,24cyclictest0-21swapper/106:06:161
10407996735,27cyclictest0-21swapper/305:53:373
10407996726,34cyclictest16045-21fschecks_count05:43:123
1040699673,59cyclictest0-21swapper/206:13:062
1040699673,57cyclictest6708-21chrt06:32:272
1040699672,37cyclictest0-21swapper/205:53:062
10407996527,32cyclictest0-21swapper/307:07:553
10407996441,17cyclictest3862-21unixbench-2d06:23:253
10407996432,26cyclictest1419-21runrttasks07:24:233
1040699644,53cyclictest0-21swapper/205:32:562
10407996342,14cyclictest7009-21head06:33:043
10407995638,11cyclictest1419-21runrttasks05:32:563
1039999538,8cyclictest7250irq/45-ahci05:48:070
102042444,34sleep00-21swapper/005:30:450
1040499383,8cyclictest10479-21cat05:32:571
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional