You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-24 - 11:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Wed Dec 24, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22536999734,47cyclictest15276-21awk20:59:441
22536999733,48cyclictest0-21swapper/123:02:361
2254099963,7cyclictest30037-21cpuspeed_turbos23:44:542
22536999331,55cyclictest0-21swapper/122:35:041
22536999328,8cyclictest15225-21runrttasks00:19:591
2253699923,21cyclictest0-21swapper/123:30:011
22536999136,44cyclictest0-21swapper/100:19:361
2254099903,80cyclictest0-21swapper/223:20:022
2254099884,47cyclictest29037-21switchtime19:10:192
2254099884,29cyclictest0-21swapper/219:40:112
22540998833,11cyclictest7655-21unixbench_multi20:40:202
22540998833,10cyclictest341-21tune2fs23:49:562
22540998829,12cyclictest0-21swapper/221:24:442
2253699884,13cyclictest0-21swapper/121:15:121
22536998824,12cyclictest0-21swapper/123:49:391
22536998824,12cyclictest0-21swapper/120:05:091
22531998828,47cyclictest0-21swapper/020:43:300
22540998712,24cyclictest1419-21runrttasks23:32:482
2253699875,27cyclictest0-21swapper/121:07:231
2253699875,27cyclictest0-21swapper/121:07:231
2253699873,78cyclictest0-21swapper/119:14:501
22536998722,8cyclictest5420-21cut21:45:021
22536998719,11cyclictest0-21swapper/119:29:591
2253199873,76cyclictest15426-21munin-node23:15:120
2253699864,31cyclictest28679-21munin-node20:20:191
22536998629,9cyclictest1419-21runrttasks22:54:491
22536998628,51cyclictest0-21swapper/119:05:201
22536998627,8cyclictest1419-21runrttasks20:32:151
2253199863,77cyclictest0-21swapper/022:54:580
22531998620,11cyclictest0-21swapper/000:27:010
2253699856,15cyclictest0-21swapper/122:47:401
2253699855,25cyclictest0-21swapper/121:59:581
2253699854,36cyclictest0-21swapper/120:40:041
2253699854,32cyclictest25064-21munin-node21:20:001
2253699854,32cyclictest17867-21munin-node19:55:111
2253699854,24cyclictest13741-21cut23:09:581
22536998532,43cyclictest0-21swapper/123:39:501
22536998528,9cyclictest1419-21runrttasks22:34:221
22536998528,9cyclictest1419-21runrttasks22:34:221
22536998526,8cyclictest4229-21fschecks_time22:50:021
22531998530,49cyclictest0-21swapper/023:00:040
2253199853,9cyclictest1970-21crond21:39:430
2253699849,12cyclictest0-21swapper/122:39:531
2253699845,26cyclictest0-21swapper/120:34:561
2253699845,13cyclictest0-21swapper/119:02:021
2253699844,32cyclictest9564-21munin-node19:40:191
22536998429,7cyclictest3123-21gltestperf21:40:041
22536998427,8cyclictest1419-21runrttasks19:18:311
2253199844,73cyclictest0-21swapper/023:14:390
2253199844,73cyclictest0-21swapper/022:24:410
2253199843,74cyclictest0-21swapper/022:05:030
22531998427,39cyclictest0-21swapper/020:08:480
22531998423,43cyclictest0-21swapper/022:45:080
22531998422,44cyclictest0-21swapper/022:26:140
22540998328,12cyclictest0-21swapper/219:05:022
2253699834,21cyclictest0-21swapper/123:09:021
22536998332,37cyclictest0-21swapper/119:35:181
2253699833,23cyclictest18536-21chrt00:27:021
22536998328,9cyclictest8807-21unixbench_singl00:05:101
22536998328,8cyclictest24834-21interrupts22:25:041
22536998321,12cyclictest0-21swapper/121:29:441
22536998311,12cyclictest0-21swapper/120:46:021
2253199835,67cyclictest0-21swapper/020:16:130
22531998330,39cyclictest0-21swapper/019:04:060
2253199833,16cyclictest0-21swapper/019:40:010
2253199832,26cyclictest16508-21latency_hist19:54:480
22540998231,12cyclictest0-21swapper/219:17:092
22540998219,12cyclictest0-21swapper/223:04:542
2253699824,72cyclictest0-21swapper/123:25:021
2253699823,23cyclictest0-21swapper/121:04:451
22536998220,7cyclictest2050-21idleruntime-cro19:24:481
2253199824,71cyclictest0-21swapper/023:44:510
24382810,2sleep1201ktimersoftd/119:25:001
2253699815,27cyclictest22229-21sshd21:12:071
2253699815,17cyclictest0-21swapper/120:02:121
2253699814,23cyclictest0-21swapper/121:34:551
22536998128,8cyclictest1419-21runrttasks23:52:521
22531998128,46cyclictest0-21swapper/019:45:020
2253699803,26cyclictest0-21swapper/121:54:431
2253699803,26cyclictest0-21swapper/121:54:431
2253199803,70cyclictest0-21swapper/021:30:000
2253199803,70cyclictest0-21swapper/020:03:360
2253199803,70cyclictest0-21swapper/000:14:590
2253199803,32cyclictest6149-21taskset00:00:100
22531998028,40cyclictest0-21swapper/022:11:160
22531998025,49cyclictest16737-21netstat21:00:120
22531998024,50cyclictest0-21swapper/020:39:460
22531998023,8cyclictest20489-21cpuspeed_turbos23:24:540
22531998022,45cyclictest0-21swapper/022:39:300
22531998022,10cyclictest2300-21aten_r1power_fr23:54:520
22531998022,10cyclictest2300-21aten_r1power_fr23:54:520
2253199802,28cyclictest4474-21latency_hist21:44:440
2253699794,23cyclictest0-21swapper/123:54:521
2253699794,23cyclictest0-21swapper/123:54:521
2253699794,13cyclictest10836-21head20:50:021
2253699793,38cyclictest0-21swapper/123:19:401
22536997929,42cyclictest0-21swapper/119:50:221
22536997914,12cyclictest0-21swapper/119:47:091
22536997912,14cyclictest0-21swapper/120:10:021
2253199794,23cyclictest0-21swapper/019:10:050
2253199793,70cyclictest0-21swapper/019:55:090
2253199793,69cyclictest0-21swapper/023:36:470
22531997925,39cyclictest0-21swapper/021:55:090
2253199792,30cyclictest1287-21snmpd22:15:580
22531997917,9cyclictest26057-21latency_hist20:14:470
22531997910,19cyclictest0-21swapper/020:47:550
113362790,4chrt11337-21fschecks_count20:50:070
2253699785,33cyclictest0-21swapper/123:35:161
2253699783,24cyclictest18811-21munin-node23:20:011
22536997823,11cyclictest0-21swapper/118:59:501
22536997823,11cyclictest0-21swapper/118:59:501
2253199785,66cyclictest0-21swapper/023:19:510
2253199783,17cyclictest0-21swapper/019:05:120
22531997823,48cyclictest25064-21munin-node21:20:190
22531997822,9cyclictest2778-21cstates19:25:020
22531997821,50cyclictest0-21swapper/021:45:050
22531997818,10cyclictest28273-21http_loadtime23:39:590
22531997814,13cyclictest0-21swapper/000:04:510
22531997813,13cyclictest0-21swapper/019:20:030
22536997726,9cyclictest31072-21netstat21:30:091
22536997721,10cyclictest0-21swapper/100:00:001
2253199773,67cyclictest20312-21telnet21:09:550
2253199773,67cyclictest0-21swapper/021:25:000
2253199773,10cyclictest0-21swapper/000:09:530
22531997722,9cyclictest1255-21timerandwakeup23:50:100
22531997721,11cyclictest0-21swapper/020:31:010
2253699764,12cyclictest0-21swapper/122:23:411
22536997628,8cyclictest15229-21if_err_eth022:05:041
2253199766,64cyclictest0-21swapper/020:20:240
22531997620,8cyclictest31600-21unixbench_multi19:15:250
22531997617,8cyclictest1419-21runrttasks19:30:570
22531997616,10cyclictest31484-21df_abs22:39:560
22531997611,14cyclictest0-21swapper/021:14:590
2253699755,14cyclictest0-21swapper/121:54:571
2253699754,21cyclictest0-21swapper/100:09:541
2253699753,33cyclictest0-21swapper/122:09:591
2253199754,11cyclictest0-21swapper/021:59:580
2253199754,11cyclictest0-21swapper/021:50:100
2253199754,11cyclictest0-21swapper/021:50:100
22531997521,9cyclictest13331-21cpuspeed20:54:590
22531997520,8cyclictest1419-21runrttasks23:29:510
2253199752,33cyclictest1287-21snmpd20:27:030
2253199752,33cyclictest1287-21snmpd20:27:030
22531997519,9cyclictest12674-21sshd23:08:070
22531997515,9cyclictest5251-21unixbench_singl22:50:170
2253199744,14cyclictest0-21swapper/000:20:060
22531997423,9cyclictest19055-21missed_timers21:05:090
22531997423,9cyclictest19055-21missed_timers21:05:090
22536997326,11cyclictest0-21swapper/122:15:131
2253699724,33cyclictest0-21swapper/120:15:531
22531997220,9cyclictest1419-21runrttasks22:29:570
22531997220,9cyclictest1419-21runrttasks22:29:570
22540997024,10cyclictest0-21swapper/221:35:042
2253199703,13cyclictest0-21swapper/019:35:060
2253699664,14cyclictest0-21swapper/120:25:111
2253699664,14cyclictest0-21swapper/120:25:111
22540996231,13cyclictest0-21swapper/222:39:532
2254099603,51cyclictest0-21swapper/219:44:592
2254299594,11cyclictest15110-21fschecks_time19:50:083
22540995931,11cyclictest0-21swapper/223:39:512
2254099593,50cyclictest0-21swapper/221:10:172
2254299585,12cyclictest0-21swapper/319:44:483
22540995828,12cyclictest0-21swapper/222:59:552
22540995741,10cyclictest5917-21grep21:45:092
2254299564,13cyclictest0-21swapper/300:19:373
2254299564,12cyclictest16153-21runrttasks00:22:013
22542995618,32cyclictest17520-21sort00:24:563
22540995632,9cyclictest5552-21fschecks_time19:30:052
22540995626,13cyclictest0-21swapper/222:38:122
282712555,7sleep20-21swapper/221:25:042
248599550,7rtkit-daemon2484-21rtkit-daemon18:56:143
248599550,7rtkit-daemon2484-21rtkit-daemon18:56:143
22542995539,10cyclictest23630-21gltestperf19:00:103
22542995538,11cyclictest27855-21tr19:10:023
22540995526,13cyclictest0-21swapper/220:50:222
22540995523,19cyclictest0-21swapper/200:25:472
22540995440,9cyclictest27015-21grep22:30:012
22540995440,9cyclictest27015-21grep22:30:012
2254299534,43cyclictest0-21swapper/320:24:413
2254299534,42cyclictest0-21swapper/323:34:393
2254299534,41cyclictest0-21swapper/322:09:043
22542995310,37cyclictest0-21swapper/320:59:453
18532533,10sleep30-21swapper/323:53:563
319922522,10sleep30-21swapper/319:18:583
294912523,9sleep30-21swapper/323:44:133
2254299525,41cyclictest0-21swapper/320:05:073
2254299524,42cyclictest0-21swapper/319:32:063
2254299524,41cyclictest0-21swapper/321:44:553
2254299524,41cyclictest0-21swapper/319:05:143
2254299524,40cyclictest0-21swapper/300:09:493
22542995234,11cyclictest27723-21cpuspeed_turbos21:24:573
2254299522,44cyclictest0-21swapper/323:19:553
2254099523,44cyclictest0-21swapper/220:56:452
22540995223,12cyclictest0-21swapper/219:29:482
22540995222,14cyclictest0-21swapper/222:54:402
2254099522,44cyclictest0-21swapper/222:20:182
68332512,10sleep30-21swapper/320:40:083
303342514,40sleep330341-21diskstats23:44:573
242372517,36sleep20-21swapper/220:10:042
2254299514,41cyclictest0-21swapper/322:50:103
2254299514,40cyclictest0-21swapper/322:35:013
2254299514,40cyclictest0-21swapper/320:45:063
2254099513,7cyclictest30868-21kernelversion21:30:062
22540995125,10cyclictest0-21swapper/221:59:232
19892512,10sleep30-21swapper/319:24:063
2254299504,40cyclictest0-21swapper/321:55:043
22540995033,9cyclictest25830-21cut23:35:002
2254099502,11cyclictest0-21swapper/219:20:052
42242492,10sleep30-21swapper/321:41:333
2254299494,40cyclictest0-21swapper/322:00:143
2254299494,39cyclictest0-21swapper/322:25:163
2254299494,39cyclictest0-21swapper/321:50:183
2254299494,39cyclictest0-21swapper/321:50:183
2254299494,39cyclictest0-21swapper/320:00:243
22542994933,11cyclictest18775-21gltestperf21:05:043
22542994933,11cyclictest18775-21gltestperf21:05:043
2254299493,42cyclictest0-21swapper/321:33:063
22540994935,8cyclictest16504-21crond19:54:472
2254099493,38cyclictest0-21swapper/222:24:562
2254099493,38cyclictest0-21swapper/219:35:052
22540994929,7cyclictest1287-21snmpd22:12:342
2254099492,11cyclictest0-21swapper/223:54:522
2254099492,11cyclictest0-21swapper/223:54:522
2254099492,11cyclictest0-21swapper/220:38:312
139982493,10sleep30-21swapper/319:48:373
101452492,40sleep20-21swapper/220:45:352
2254299484,39cyclictest0-21swapper/323:35:143
2254299484,39cyclictest0-21swapper/300:05:013
2254299484,37cyclictest0-21swapper/321:20:033
2254299484,37cyclictest0-21swapper/300:03:283
22542994832,9cyclictest24824-21crond21:19:443
22542994832,10cyclictest11569-21cut20:50:093
22542994831,11cyclictest13360-21cpuspeed_turbos23:09:533
2254099484,27cyclictest0-21swapper/221:05:202
2254099484,27cyclictest0-21swapper/221:05:202
2254099484,27cyclictest0-21swapper/220:20:042
2254099484,26cyclictest0-21swapper/223:59:552
2254099484,26cyclictest0-21swapper/220:30:112
2254099483,40cyclictest0-21swapper/219:55:152
2254099482,11cyclictest0-21swapper/222:03:112
101432483,9sleep30-21swapper/323:01:133
2254299474,36cyclictest0-21swapper/320:59:583
22542994731,9cyclictest21064-21gltestperf23:24:593
2254099473,8cyclictest1287-21snmpd22:18:482
2254099473,28cyclictest0-21swapper/223:25:082
22540994726,10cyclictest0-21swapper/200:20:092
22540994725,9cyclictest0-21swapper/200:09:492
2254099472,8cyclictest20337-21strings20:00:152
2254099472,11cyclictest0-21swapper/222:54:512
2254099472,11cyclictest0-21swapper/221:52:002
2254099472,11cyclictest0-21swapper/221:52:002
2254099472,11cyclictest0-21swapper/221:16:032
2254299465,34cyclictest0-21swapper/322:10:073
2254299464,35cyclictest30975-21yum-updatesd-he22:40:003
22542994630,9cyclictest20322-21aten_r1power_en21:09:553
2254099464,37cyclictest0-21swapper/200:14:552
22540994631,10cyclictest3190-21gltestperf21:40:042
22540994625,10cyclictest0-21swapper/220:09:042
22540994624,10cyclictest0-21swapper/219:01:052
22540994623,11cyclictest0-21swapper/221:00:022
22540994622,12cyclictest0-21swapper/223:09:512
2254099462,11cyclictest0-21swapper/222:44:442
2254099462,11cyclictest0-21swapper/222:07:342
282502452,37sleep30-21swapper/322:33:163
282502452,37sleep30-21swapper/322:33:163
2254299455,34cyclictest0-21swapper/320:15:003
2254099453,26cyclictest0-21swapper/220:15:032
2254099452,30cyclictest0-21swapper/223:15:102
2254299445,30cyclictest0-21swapper/322:20:133
2254299444,33cyclictest3973-21df20:35:003
2254299443,11cyclictest0-21swapper/319:25:183
22542994429,10cyclictest1828-21gltestperf22:45:003
22542994428,10cyclictest12339-21unixbench_multi23:05:133
22540994416,12cyclictest0-21swapper/200:07:542
223852443,35sleep00-21swapper/018:58:160
223852443,35sleep00-21swapper/018:58:160
19332443,9sleep30-21swapper/321:39:243
172752443,35sleep30-21swapper/323:15:483
2254299434,10cyclictest2415-21ntp_states20:30:153
2254299433,9cyclictest2245-21cut23:54:513
2254299433,9cyclictest2245-21cut23:54:513
22542994328,9cyclictest19400-21cpuspeed_turbos22:14:563
22542994317,10cyclictest0-21swapper/322:54:513
22540994317,11cyclictest31155-21telnet20:24:592
22540994317,11cyclictest31155-21telnet20:24:592
2254299424,34cyclictest0-21swapper/320:10:173
2254299422,9cyclictest0-21swapper/319:35:353
22542994214,12cyclictest0-21swapper/320:25:003
22542994214,12cyclictest0-21swapper/320:25:003
222662424,32sleep20-21swapper/218:56:462
222662424,32sleep20-21swapper/218:56:462
2254299414,30cyclictest0-21swapper/319:55:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional