You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-18 - 09:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sat Apr 18, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21650991075,95cyclictest18019-21munin-node19:17:170
216549910442,46cyclictest0-21swapper/319:37:073
21650991034,92cyclictest1419-21runrttasks21:52:090
21650991025,89cyclictest9560-21grep20:37:150
21650991023,91cyclictest0-21swapper/022:30:110
2546821010,4sleep125470-21cut17:17:151
2546821010,4sleep125470-21cut17:17:151
216549910141,46cyclictest0-21swapper/322:07:063
21650991016,29cyclictest0-21swapper/020:08:400
21650991004,89cyclictest0-21swapper/021:16:580
21650991004,88cyclictest0-21swapper/021:51:390
21650991004,27cyclictest0-21swapper/019:32:000
2165099996,86cyclictest0-21swapper/018:01:580
2165099994,88cyclictest0-21swapper/020:31:560
2165099994,88cyclictest0-21swapper/020:22:100
2165099985,86cyclictest0-21swapper/019:54:140
2165099985,85cyclictest0-21swapper/018:37:160
2165099985,84cyclictest0-21swapper/021:11:540
2165099984,26cyclictest0-21swapper/022:38:060
2165099983,87cyclictest124971munin-node21:32:090
2165499974,84cyclictest4706-21cpuspeed_turbos20:31:563
2165299979,7cyclictest0-21swapper/122:13:091
21652999721,56cyclictest0-21swapper/122:28:341
2165099975,84cyclictest0-21swapper/021:04:570
2165099974,85cyclictest0-21swapper/019:46:040
2165099974,24cyclictest0-21swapper/021:37:460
21650999735,11cyclictest20198-21sed21:42:000
2165099973,87cyclictest0-21swapper/021:07:420
2165299964,9cyclictest121850irq/46-eth021:33:451
21652999628,49cyclictest23765-21df_abs20:11:581
2165099968,81cyclictest28192-21idleruntime-cro19:31:450
2165099965,84cyclictest0-21swapper/022:09:360
2165099965,84cyclictest0-21swapper/020:13:320
2165099964,30cyclictest0-21swapper/017:56:480
2165499956,28cyclictest31189-21munin-run17:31:493
2165399955,82cyclictest0-21swapper/220:16:062
2165099954,84cyclictest0-21swapper/020:44:080
2165099954,84cyclictest0-21swapper/019:58:460
21650999534,55cyclictest0-21swapper/020:46:580
21650999534,55cyclictest0-21swapper/020:46:580
2165099953,85cyclictest0-21swapper/022:33:490
21650999511,9cyclictest1404-21ssh22:02:030
21650999511,9cyclictest1404-21ssh22:02:030
21654999438,42cyclictest0-21swapper/319:57:413
21654999421,10cyclictest17086-21taskset19:14:343
2165399943,83cyclictest16276-21tail20:47:132
2165399943,83cyclictest16276-21tail20:47:132
2165099945,82cyclictest0-21swapper/022:19:510
2165099945,82cyclictest0-21swapper/022:14:070
2165099945,82cyclictest0-21swapper/020:18:510
2165099945,82cyclictest0-21swapper/018:57:140
2165099943,84cyclictest31893-21munin-node19:37:020
2165099943,84cyclictest0-21swapper/021:57:070
2165099943,83cyclictest0-21swapper/021:26:560
2165099943,83cyclictest0-21swapper/021:26:560
2165099943,25cyclictest0-21swapper/018:08:100
21654999344,32cyclictest0-21swapper/320:17:133
2165499933,83cyclictest0-21swapper/321:56:523
2165099934,24cyclictest0-21swapper/020:54:290
2165499925,23cyclictest26577-21munin-node21:51:553
21654999217,11cyclictest4593-21timerandwakeup19:42:163
2165099925,81cyclictest0-21swapper/022:26:250
2165099924,81cyclictest31178-21turbostat.cron17:31:490
2165099924,81cyclictest0-21swapper/021:00:560
2165099924,81cyclictest0-21swapper/019:46:490
2165099924,25cyclictest0-21swapper/017:32:010
2165499918,61cyclictest0-21swapper/321:44:443
2165499916,78cyclictest29016-21irqstats21:07:053
2165499916,15cyclictest0-21swapper/320:57:073
2165399914,80cyclictest27827-21grep20:17:072
2165399914,78cyclictest0-21swapper/219:15:012
21652999128,49cyclictest0-21swapper/119:30:151
2165099916,78cyclictest0-21swapper/020:02:160
2165099915,79cyclictest0-21swapper/021:23:550
2165099914,17cyclictest0-21swapper/018:33:140
2165099913,82cyclictest0-21swapper/019:22:010
2165499906,77cyclictest0-21swapper/321:02:073
2165499904,80cyclictest0-21swapper/322:19:033
21654999014,9cyclictest121850irq/46-eth020:01:583
2165399903,80cyclictest0-21swapper/219:43:262
2165399903,78cyclictest0-21swapper/220:57:262
21652999033,44cyclictest31510-21ssh19:36:211
2165299903,12cyclictest6900-21ssh22:11:381
21652999023,50cyclictest0-21swapper/120:31:421
2165499896,28cyclictest3899-21sensors21:17:093
2165499895,76cyclictest25187-21memory22:37:023
2165499893,31cyclictest0-21swapper/321:24:463
2165299899,8cyclictest121850irq/46-eth021:22:001
2165299895,22cyclictest14387-21diskmemload22:18:061
21652998928,44cyclictest0-21swapper/120:56:471
21652998923,50cyclictest0-21swapper/120:26:431
2165099894,79cyclictest0-21swapper/019:16:000
2165099894,78cyclictest0-21swapper/018:31:480
2165099894,26cyclictest2114-21missed_timers20:27:070
2165499886,25cyclictest0-21swapper/321:39:353
2165499886,15cyclictest0-21swapper/320:53:393
2165499885,76cyclictest0-21swapper/320:06:573
2165499885,26cyclictest0-21swapper/322:04:263
2165499885,26cyclictest0-21swapper/322:04:263
2165499884,77cyclictest0-21swapper/321:51:393
2165499884,77cyclictest0-21swapper/321:11:533
2165499884,70cyclictest0-21swapper/318:17:053
21654998814,13cyclictest0-21swapper/319:27:053
2165299886,9cyclictest121850irq/46-eth019:55:121
2165299884,76cyclictest1419-21runrttasks21:20:051
21652998821,46cyclictest0-21swapper/119:45:061
2165499874,76cyclictest0-21swapper/319:24:183
2165499874,21cyclictest31008-21iostat_ios20:22:053
21654998725,56cyclictest0-21swapper/319:17:013
21654998721,10cyclictest11511-21cstates20:41:563
2165399875,75cyclictest0-21swapper/222:02:022
2165399875,75cyclictest0-21swapper/222:02:022
2165399874,76cyclictest0-21swapper/222:06:572
2165299873,8cyclictest31893-21munin-node19:37:041
2165299873,77cyclictest18738-21gltestperf20:52:011
2165299873,24cyclictest0-21swapper/122:35:501
2165099874,23cyclictest0-21swapper/017:12:020
2165499867,14cyclictest0-21swapper/322:32:073
2165499866,73cyclictest0-21swapper/318:00:583
2165499866,73cyclictest0-21swapper/318:00:583
2165499865,74cyclictest0-21swapper/321:26:553
2165499865,74cyclictest0-21swapper/321:26:553
2165499865,61cyclictest0-21swapper/318:12:213
2165499865,24cyclictest0-21swapper/322:16:123
2165499864,74cyclictest14387-21diskmemload19:56:423
2165499864,24cyclictest14304-21unixbench_singl21:32:133
21654998621,10cyclictest6047-21crond17:46:483
2165399864,75cyclictest0-21swapper/218:07:292
2165299865,22cyclictest0-21swapper/122:25:221
2165299864,74cyclictest0-21swapper/121:06:521
2165299863,66cyclictest0-21swapper/122:00:421
2165299863,12cyclictest0-21swapper/120:00:191
21652998628,41cyclictest0-21swapper/120:48:281
21652998628,41cyclictest0-21swapper/120:48:281
21652998625,45cyclictest0-21swapper/121:03:581
21652998624,48cyclictest0-21swapper/118:43:161
21652998624,48cyclictest0-21swapper/118:43:161
2165099865,26cyclictest0-21swapper/018:21:470
21650998630,8cyclictest19122-21gltestperf18:12:070
2165099863,10cyclictest0-21swapper/017:47:120
2165499858,18cyclictest0-21swapper/317:21:503
2165499858,18cyclictest0-21swapper/317:21:503
2165499855,60cyclictest0-21swapper/320:15:223
2165499854,75cyclictest0-21swapper/317:32:203
2165499854,74cyclictest0-21swapper/322:29:573
2165499854,73cyclictest0-21swapper/320:47:043
2165499854,73cyclictest0-21swapper/320:47:043
2165499854,24cyclictest0-21swapper/320:36:583
2165499854,12cyclictest1419-21runrttasks20:30:003
2165399855,73cyclictest0-21swapper/221:36:572
2165399854,74cyclictest0-21swapper/222:22:112
2165399854,74cyclictest0-21swapper/219:31:542
2165399853,74cyclictest30749-21processes21:57:072
2165399853,48cyclictest0-21swapper/220:22:442
21652998541,37cyclictest14387-21diskmemload21:41:541
21652998516,12cyclictest0-21swapper/119:23:091
2165099854,26cyclictest0-21swapper/018:48:170
2165499844,28cyclictest0-21swapper/318:23:133
2165499844,25cyclictest0-21swapper/319:48:273
21654998419,16cyclictest0-21swapper/317:47:023
2165399844,74cyclictest0-21swapper/219:26:592
2165399844,73cyclictest0-21swapper/221:47:342
2165399844,72cyclictest0-21swapper/220:31:092
2165399844,52cyclictest1419-21runrttasks19:48:202
2165399843,73cyclictest30603-21ssh21:10:052
2165399843,73cyclictest0-21swapper/222:18:152
2165399843,73cyclictest0-21swapper/221:15:422
2165299847,20cyclictest0-21swapper/120:10:591
2165299844,19cyclictest0-21swapper/120:41:511
2165299843,71cyclictest0-21swapper/121:28:591
2165299843,71cyclictest0-21swapper/121:28:591
21652998424,47cyclictest0-21swapper/122:39:191
21652998422,40cyclictest0-21swapper/122:02:021
21652998422,40cyclictest0-21swapper/122:02:021
2165099844,29cyclictest0-21swapper/017:38:060
2165099844,24cyclictest0-21swapper/017:17:230
2165099844,24cyclictest0-21swapper/017:17:230
2165499835,72cyclictest0-21swapper/319:32:523
2165499834,27cyclictest11026-21tail19:02:103
2165499834,14cyclictest0-21swapper/322:23:293
2165399837,58cyclictest0-21swapper/221:27:242
2165399837,58cyclictest0-21swapper/221:27:242
2165399834,72cyclictest0-21swapper/218:17:032
2165399834,48cyclictest0-21swapper/220:42:062
2165399833,74cyclictest0-21swapper/217:42:212
2165399833,73cyclictest26857-21gltestperf21:51:572
2165399833,73cyclictest0-21swapper/219:17:062
2165399833,72cyclictest24317-21ssh19:25:352
2165399833,72cyclictest17214-21cut20:01:592
2165399833,63cyclictest0-21swapper/220:56:432
2165299839,57cyclictest0-21swapper/119:19:291
2165299833,72cyclictest0-21swapper/119:50:081
2165299833,21cyclictest0-21swapper/121:14:411
21652998329,48cyclictest14257-21gltestperf18:02:061
21652998324,40cyclictest0-21swapper/120:32:401
21652998320,49cyclictest0-21swapper/119:15:131
2165099834,14cyclictest0-21swapper/019:07:040
2165499824,73cyclictest0-21swapper/318:26:573
21654998230,43cyclictest22692-21tail17:12:093
2165399824,71cyclictest24702-21ssh21:01:532
2165399824,71cyclictest0-21swapper/220:11:442
2165399824,70cyclictest0-21swapper/221:16:562
2165399823,73cyclictest0-21swapper/219:56:592
2165399823,72cyclictest1287-21snmpd22:28:042
2165399823,72cyclictest1287-21snmpd18:43:162
2165399823,72cyclictest1287-21snmpd18:43:162
2165399823,72cyclictest0-21swapper/221:23:572
2165399823,64cyclictest0-21swapper/221:42:222
2165399823,63cyclictest0-21swapper/220:31:562
2165399822,73cyclictest27078-21ssh22:41:322
2165299824,72cyclictest16537-21kworker/1:220:38:571
2165299824,72cyclictest0-21swapper/121:55:191
2165299823,72cyclictest17978-21ssh21:38:041
2165299823,72cyclictest0-21swapper/118:32:191
21652998227,41cyclictest26633-21telnet20:16:541
21652998225,51cyclictest7780-21cpuspeed_turbos18:56:591
21652998225,43cyclictest0-21swapper/120:02:161
21652998224,38cyclictest0-21swapper/117:34:001
21652998222,53cyclictest22830-21cpu21:46:511
2165099824,17cyclictest0-21swapper/018:51:560
2165099823,42cyclictest0-21swapper/018:25:190
2165499816,21cyclictest0-21swapper/317:22:123
2165499813,12cyclictest0-21swapper/319:06:553
21654998122,11cyclictest5790-21fschecks_time18:52:023
21654998122,10cyclictest4423-21unixbench_singl18:47:193
2165299813,27cyclictest0-21swapper/118:56:471
2165299813,27cyclictest0-21swapper/118:41:071
2165299813,24cyclictest0-21swapper/118:26:571
21652998123,51cyclictest7140-21gltestperf17:47:071
2165099814,14cyclictest0-21swapper/019:06:450
2165099813,24cyclictest0-21swapper/017:22:020
2165499805,16cyclictest0-21swapper/318:01:593
2165499804,13cyclictest0-21swapper/318:41:463
21654998021,9cyclictest15996-21aten_r1power_vo18:07:003
21654998017,11cyclictest9943-21ntpq17:52:153
2165399805,67cyclictest0-21swapper/219:37:032
2165399803,71cyclictest22031-21taskset17:12:022
21652998017,13cyclictest0-21swapper/118:08:291
2165099803,70cyclictest0-21swapper/017:46:150
2165499795,66cyclictest0-21swapper/318:57:023
2165399792,70cyclictest0-21swapper/217:51:592
2165299794,68cyclictest1287-21snmpd17:23:041
21654997822,12cyclictest2336-21gltestperf17:37:083
2165399786,64cyclictest0-21swapper/222:13:192
2165399784,67cyclictest0-21swapper/219:53:032
2165399784,67cyclictest0-21swapper/218:22:042
2165399784,67cyclictest0-21swapper/218:12:032
2165399784,46cyclictest0-21swapper/220:40:472
2165399783,69cyclictest0-21swapper/218:02:472
2165399783,67cyclictest0-21swapper/221:32:062
2165399783,66cyclictest1681-21nscd18:00:242
2165399783,66cyclictest1681-21nscd18:00:242
21653997813,42cyclictest29049-21aten2.4-expect17:27:012
2165299784,65cyclictest23398-21threads17:12:211
21652997825,47cyclictest1419-21runrttasks18:16:321
21652997825,47cyclictest13026-21gltestperf19:07:041
21652997825,39cyclictest0-21swapper/118:47:011
21652997824,48cyclictest12099-21kernelversion17:57:111
21652997824,48cyclictest12099-21kernelversion17:57:111
2165499774,24cyclictest0-21swapper/318:41:593
2165499774,24cyclictest0-21swapper/318:41:593
2165399773,67cyclictest0-21swapper/222:31:582
2165399773,42cyclictest0-21swapper/217:37:052
2165299773,23cyclictest0-21swapper/117:43:081
2165299773,13cyclictest0-21swapper/117:27:071
21652997720,9cyclictest10353-21df_abs19:02:011
2165099774,14cyclictest0-21swapper/018:42:020
2165099774,14cyclictest0-21swapper/018:42:020
21654997611,9cyclictest121850irq/46-eth018:32:073
21653997625,35cyclictest12525-21cpuspeed_turbos19:06:592
21652997623,47cyclictest23053-21aten_r1power_en18:21:591
2165099764,14cyclictest0-21swapper/017:56:530
2165099764,14cyclictest0-21swapper/017:56:530
2165399755,42cyclictest0-21swapper/218:47:082
2165399754,63cyclictest0-21swapper/217:47:162
2165299754,11cyclictest1287-21snmpd18:17:101
2165299753,10cyclictest0-21swapper/117:54:111
2165299743,64cyclictest1970-21diskstats17:37:051
2165399733,63cyclictest27343-21tune2fs17:22:062
2165399723,61cyclictest27872-21aten_r1power_fr18:31:592
2165399723,41cyclictest27027-21timerwakeupswit18:27:182
2165399713,62cyclictest30295-21aten_r1power_po18:36:592
2165399713,61cyclictest31723-21cpuspeed_turbos17:32:022
2165299703,11cyclictest0-21swapper/117:11:501
2165399694,57cyclictest0-21swapper/218:53:472
2165399685,56cyclictest0-21swapper/217:17:072
2165399685,56cyclictest0-21swapper/217:17:072
2165399673,56cyclictest7463-21aten_r1power_cu18:56:562
2165399663,57cyclictest0-21swapper/217:11:502
2165399654,55cyclictest0-21swapper/219:02:102
213682464,36sleep00-21swapper/017:08:340
2165499415,30cyclictest0-21swapper/317:11:503
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional