You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-04 - 08:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sat Apr 04, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
130519910723,40cyclictest0-21swapper/222:30:232
13051991035,13cyclictest0-21swapper/219:59:072
130509910334,49cyclictest0-21swapper/119:30:261
13051991024,12cyclictest0-21swapper/221:25:192
13051991024,12cyclictest0-21swapper/221:25:192
13045991025,90cyclictest27952-21grep21:30:210
1304599995,87cyclictest0-21swapper/022:15:360
13045999919,21cyclictest9405-21fschecks_count22:40:040
1305199985,72cyclictest0-21swapper/219:30:282
1305199985,70cyclictest0-21swapper/220:48:292
13050999832,48cyclictest0-21swapper/121:20:031
1304599984,87cyclictest31155-21ssh20:00:150
1304599984,87cyclictest31155-21ssh20:00:150
1304599984,87cyclictest0-21swapper/021:46:010
1304599984,87cyclictest0-21swapper/019:34:410
13050999734,48cyclictest14382-21timerwakeupswit21:10:241
1304599975,85cyclictest0-21swapper/020:25:040
1304599974,86cyclictest0-21swapper/022:50:110
1304599974,86cyclictest0-21swapper/021:53:310
1304599974,86cyclictest0-21swapper/021:36:330
1304599974,85cyclictest0-21swapper/021:16:060
1305199965,13cyclictest0-21swapper/221:01:422
1305199963,12cyclictest12088-21munin-node22:44:572
1305199963,12cyclictest12088-21munin-node22:44:572
13051999610,66cyclictest5464-21gltestperf20:10:122
1304599964,85cyclictest0-21swapper/021:21:270
1304599964,85cyclictest0-21swapper/020:17:200
1304599964,84cyclictest0-21swapper/020:09:050
1304599964,23cyclictest22297-21ssh20:35:120
1305199954,68cyclictest0-21swapper/222:27:112
1305199954,68cyclictest0-21swapper/222:09:232
1305199954,68cyclictest0-21swapper/222:09:232
13051999524,51cyclictest0-21swapper/220:53:152
1305199945,13cyclictest0-21swapper/219:40:112
13051999414,58cyclictest121850irq/46-eth020:55:032
1305099944,81cyclictest0-21swapper/122:44:471
1304599944,83cyclictest0-21swapper/022:32:290
1304599944,83cyclictest0-21swapper/019:45:240
1304599944,83cyclictest0-21swapper/017:45:110
1304599944,29cyclictest0-21swapper/020:50:230
1305199935,13cyclictest0-21swapper/221:11:252
1305199934,65cyclictest0-21swapper/217:50:152
1305199934,65cyclictest0-21swapper/217:50:152
1305199934,13cyclictest0-21swapper/220:15:032
1305199934,11cyclictest4062-21yum-updatesd-he20:09:232
13051999327,44cyclictest0-21swapper/219:45:352
13051999326,46cyclictest31263-21ssh20:00:172
13051999326,46cyclictest31263-21ssh20:00:172
1305099936,24cyclictest0-21swapper/119:05:271
1304599935,39cyclictest0-21swapper/022:00:160
1304599935,26cyclictest0-21swapper/022:45:140
1304599935,26cyclictest0-21swapper/022:45:140
1304599934,83cyclictest0-21swapper/021:55:140
1304599934,82cyclictest0-21swapper/020:45:090
1304599934,37cyclictest0-21swapper/019:40:070
1304599934,35cyclictest0-21swapper/018:05:090
1304599933,24cyclictest0-21swapper/019:38:090
248599920,5rtkit-daemon2484-21rtkit-daemon22:15:071
1305199926,61cyclictest0-21swapper/222:40:032
1305199925,62cyclictest0-21swapper/220:40:032
1305199925,62cyclictest0-21swapper/220:40:032
1305199925,12cyclictest0-21swapper/218:05:112
1305199924,66cyclictest0-21swapper/220:34:532
1305199924,14cyclictest0-21swapper/219:51:132
1305199923,9cyclictest121850irq/46-eth022:00:062
13051999220,48cyclictest0-21swapper/221:40:172
13050999231,47cyclictest0-21swapper/122:30:261
1304599925,25cyclictest0-21swapper/019:59:400
1304599925,13cyclictest3648-21iostat_ios20:55:130
13045999230,9cyclictest27691-21proc_pri19:00:220
1305199918,62cyclictest0-21swapper/220:30:492
1305199916,62cyclictest0-21swapper/222:35:562
1305199916,12cyclictest0-21swapper/220:20:252
1305199915,65cyclictest0-21swapper/221:53:212
1305199914,66cyclictest0-21swapper/221:33:202
1305199914,13cyclictest1419-21runrttasks21:46:492
13051999118,53cyclictest0-21swapper/222:19:062
1305099913,31cyclictest3467-21gltestperf20:55:111
13050999128,48cyclictest0-21swapper/121:54:081
1304599915,28cyclictest0-21swapper/021:06:390
1304599915,12cyclictest0-21swapper/022:24:570
1304599913,37cyclictest0-21swapper/019:50:250
1305199904,70cyclictest19837-21munin-node21:20:062
1305199904,13cyclictest0-21swapper/217:45:082
1305199904,11cyclictest7410-21kworker/2:222:20:112
1305199903,11cyclictest21230-21cstates22:10:022
13050999032,36cyclictest0-21swapper/120:20:361
13050999026,49cyclictest0-21swapper/121:33:481
1304599905,35cyclictest0-21swapper/020:33:400
1304599905,25cyclictest0-21swapper/022:22:040
1304599904,79cyclictest0-21swapper/020:20:410
1304599904,34cyclictest0-21swapper/021:10:060
1304599903,24cyclictest32122-21crond18:04:580
13045999011,20cyclictest0-21swapper/022:35:120
1305199896,15cyclictest0-21swapper/222:50:142
1305199894,71cyclictest0-21swapper/220:28:532
1305199894,69cyclictest13640-21ssh19:35:122
1305199894,15cyclictest0-21swapper/218:10:092
1305199894,13cyclictest0-21swapper/221:05:582
13051998917,48cyclictest0-21swapper/217:44:582
1305099894,78cyclictest0-21swapper/120:52:271
1305099894,11cyclictest0-21swapper/122:49:471
1305099894,11cyclictest0-21swapper/122:49:471
13050998933,41cyclictest0-21swapper/119:51:271
1305099893,78cyclictest0-21swapper/119:45:211
13050998927,9cyclictest1419-21runrttasks19:25:541
13050998926,47cyclictest0-21swapper/120:32:061
1304599894,25cyclictest0-21swapper/022:11:530
13045998932,12cyclictest454-21aten_r1power_cu21:40:000
1305199884,64cyclictest0-21swapper/221:19:042
13051998817,49cyclictest0-21swapper/221:35:142
13051998817,10cyclictest7921-21fschecks_count18:20:162
13050998835,46cyclictest15929-21needreboot20:25:181
13050998832,41cyclictest0-21swapper/120:10:101
13050998831,42cyclictest0-21swapper/122:09:481
13050998831,42cyclictest0-21swapper/122:09:481
1304599885,28cyclictest0-21swapper/021:24:530
1304599885,28cyclictest0-21swapper/021:24:530
1304599885,28cyclictest0-21swapper/021:00:130
1304599884,35cyclictest0-21swapper/020:40:130
1304599884,35cyclictest0-21swapper/020:40:130
1304599884,11cyclictest0-21swapper/022:05:020
1304599884,11cyclictest0-21swapper/022:05:020
13045998824,23cyclictest0-21swapper/018:14:570
1305199874,64cyclictest0-21swapper/217:25:122
1305199874,63cyclictest0-21swapper/219:25:132
1305199874,60cyclictest0-21swapper/218:36:172
1305199874,60cyclictest0-21swapper/218:36:172
1305099874,31cyclictest0-21swapper/120:35:201
13050998722,9cyclictest21724-21gltestperf22:10:071
1304599874,24cyclictest0-21swapper/019:25:580
1304599874,24cyclictest0-21swapper/018:30:080
13045998721,8cyclictest27524-21kworker/0:120:10:140
1305199865,59cyclictest0-21swapper/221:58:222
13051998623,47cyclictest0-21swapper/219:05:102
1305099865,11cyclictest0-21swapper/119:42:161
1305099863,11cyclictest27802-21runrttasks20:44:361
1305099863,11cyclictest27802-21runrttasks20:44:361
13050998612,8cyclictest28405-21ssh22:20:081
1304599864,29cyclictest0-21swapper/018:15:090
1305199855,14cyclictest0-21swapper/217:34:592
1305099855,11cyclictest0-21swapper/119:36:071
1305099854,74cyclictest0-21swapper/119:55:061
1305099854,27cyclictest0-21swapper/120:00:231
1305099854,27cyclictest0-21swapper/120:00:231
1305099854,14cyclictest0-21swapper/122:01:381
1305099853,20cyclictest57851diskmemload21:58:591
1305099852,25cyclictest15356-21sshd17:29:101
1304599854,33cyclictest0-21swapper/018:35:290
1304599854,33cyclictest0-21swapper/018:35:290
1304599854,28cyclictest0-21swapper/017:31:060
1305099844,33cyclictest0-21swapper/122:50:111
1305099843,75cyclictest0-21swapper/121:46:351
1305099843,21cyclictest22846-21ssh21:25:001
1305099843,21cyclictest22846-21ssh21:25:001
1305099843,18cyclictest18903-21ssh21:18:491
13050998425,45cyclictest0-21swapper/121:40:061
13050998424,9cyclictest29771-21timerandwakeup20:45:231
1305199834,56cyclictest0-21swapper/219:20:172
1305099835,32cyclictest0-21swapper/121:35:521
1305099834,33cyclictest0-21swapper/118:45:081
1304599834,22cyclictest820-21sh19:14:550
13045998320,12cyclictest0-21swapper/017:50:200
13045998320,12cyclictest0-21swapper/017:50:200
1305199825,13cyclictest0-21swapper/218:55:192
1305199824,13cyclictest0-21swapper/218:50:182
1305099825,14cyclictest0-21swapper/122:35:121
1305099823,21cyclictest18694-21runrttasks18:41:311
13050998222,10cyclictest24930-21if_err_eth018:55:161
13050998216,8cyclictest121850irq/46-eth020:06:291
13050998211,10cyclictest6907-21hwlatdetect21:00:111
13045998233,11cyclictest1956-21gltestperf19:15:140
1305199815,13cyclictest0-21swapper/219:00:162
13051998139,34cyclictest18048-21munin-node17:35:322
1305099815,25cyclictest0-21swapper/121:08:221
1305099814,9cyclictest8604-21fschecks_count20:15:101
1305099814,7cyclictest30691-21perl18:00:151
1305099814,31cyclictest0-21swapper/122:26:391
13050998123,8cyclictest0-21swapper/118:25:131
1304599814,12cyclictest0-21swapper/017:40:090
1305199805,15cyclictest0-21swapper/218:30:152
1305199804,56cyclictest0-21swapper/218:17:102
1305099803,32cyclictest1287-21snmpd17:36:071
13050998021,9cyclictest16024-21cpuspeed_turbos17:30:131
1304599805,32cyclictest0-21swapper/019:20:070
1305199784,60cyclictest0-21swapper/218:25:072
13051997820,52cyclictest0-21swapper/218:43:112
13050997825,8cyclictest21887-21cpuspeed_turbos18:50:101
13050997823,9cyclictest25550-21cpuspeed_turbos17:50:121
13050997823,9cyclictest25550-21cpuspeed_turbos17:50:121
13050997823,8cyclictest1419-21runrttasks18:16:101
13050997822,9cyclictest21351-21sed17:40:171
13050997817,14cyclictest0-21swapper/117:45:301
1305199775,14cyclictest0-21swapper/219:10:242
1305199774,58cyclictest1173-21aten2.4-expect19:15:062
1305199773,56cyclictest0-21swapper/218:00:112
1305099775,28cyclictest0-21swapper/117:25:001
13050997723,8cyclictest15398-21if_eth018:35:181
13050997723,8cyclictest15398-21if_eth018:35:181
1305199764,63cyclictest0-21swapper/217:55:212
13051997622,36cyclictest0-21swapper/218:45:292
1305099764,36cyclictest0-21swapper/119:24:561
248599750,7rtkit-daemon32396-21tail20:50:113
13050997523,9cyclictest3463-21interrupts18:10:181
13050997523,11cyclictest0-21swapper/119:10:521
13050997517,9cyclictest27152-21gltestperf19:00:131
1305099743,8cyclictest2631-21ps19:15:231
1305199735,12cyclictest0-21swapper/217:25:002
1305099724,29cyclictest0-21swapper/118:20:201
1305099723,11cyclictest0-21swapper/117:57:521
13050997122,9cyclictest960-21latency18:05:211
248599690,5rtkit-daemon0-21swapper/120:55:253
1305099673,10cyclictest0-21swapper/118:34:401
248599650,6rtkit-daemon0-21swapper/019:06:220
13052996514,30cyclictest0-21swapper/320:05:223
13052996413,44cyclictest23899-21df_abs19:50:083
13052996410,34cyclictest0-21swapper/321:35:133
13052996216,39cyclictest18578-21crond22:54:463
13052996215,39cyclictest1419-21runrttasks22:12:323
13052996116,28cyclictest14402-21cpuspeed_turbos22:00:023
13052996114,39cyclictest31695-21timerandwakeup20:00:243
13052996114,39cyclictest31695-21timerandwakeup20:00:243
13052996113,41cyclictest24319-21swap21:25:203
13052996113,41cyclictest24319-21swap21:25:203
13052996015,38cyclictest26885-21grep21:30:063
13052996014,38cyclictest18146-21fschecks_count22:05:063
13052996014,38cyclictest18146-21fschecks_count22:05:063
13052996013,40cyclictest16869-21head18:40:073
13052995913,39cyclictest6466-21kernelversion22:35:113
13052995913,31cyclictest7089-21basename21:49:483
13052995911,42cyclictest21135-21needreboot19:45:203
13052995835,17cyclictest21363-21runrttasks21:20:333
13052995813,30cyclictest0-21swapper/320:34:523
13052995812,38cyclictest1419-21runrttasks20:44:123
13052995812,38cyclictest1419-21runrttasks20:44:123
13052995812,31cyclictest3062-21irqstats22:30:103
13052995811,40cyclictest10343-21timerandwakeup22:40:183
1305299579,39cyclictest16591-21cpuspeed19:40:083
1305299578,41cyclictest0-21swapper/320:20:293
13052995716,34cyclictest27903-21cpuspeed_turbos22:20:023
13052995713,38cyclictest1419-21runrttasks21:42:263
13052995712,26cyclictest1-21systemd18:45:113
13052995711,38cyclictest16610-21ssh20:25:373
1305299569,40cyclictest25141-21sed22:15:083
1305299568,29cyclictest0-21swapper/321:05:433
13052995614,35cyclictest13958-21munin-node19:35:163
13052995614,27cyclictest0-21swapper/322:48:163
13052995614,27cyclictest0-21swapper/322:48:163
13052995613,31cyclictest24966-21crond17:49:583
13052995610,40cyclictest27854-21kworker/3:221:15:043
13052995610,39cyclictest0-21swapper/322:24:583
1304599564,47cyclictest0-21swapper/018:45:230
1305299559,28cyclictest0-21swapper/320:37:303
1305299557,31cyclictest6036-21munin-node19:25:073
1305299555,43cyclictest0-21swapper/320:10:363
13052995515,25cyclictest8908-21unixbench-2d18:20:313
13052995514,35cyclictest5785-21diskmemload21:53:073
13052995514,26cyclictest10717-21aten_r1power_cu21:54:593
13052995512,24cyclictest0-21swapper/320:19:163
1305299548,40cyclictest0-21swapper/321:01:473
1305299547,40cyclictest26724-21munin-node19:55:133
1305299547,29cyclictest0-21swapper/319:31:363
1305299546,41cyclictest0-21swapper/319:05:083
13052995410,30cyclictest24990-21iostat_ios18:55:173
1304599543,44cyclictest0-21swapper/018:20:150
1305299537,30cyclictest0-21swapper/318:35:213
1305299537,30cyclictest0-21swapper/318:35:213
13052995314,24cyclictest16678-21iostat_ios17:30:203
13052995313,34cyclictest29449-21nfs_client20:45:173
13052995313,25cyclictest13660-21sh21:10:123
1304599525,28cyclictest0-21swapper/017:26:050
1305299519,36cyclictest25777-21diskstats17:50:143
1305299519,36cyclictest25777-21diskstats17:50:143
13052995113,31cyclictest29442-21sshd17:56:083
13052995110,34cyclictest0-21swapper/318:09:123
127132514,6sleep00-21swapper/017:21:050
13052995035,9cyclictest5731-21gltestperf18:15:163
13052995013,30cyclictest1995-21gltestperf19:15:143
13052995011,11cyclictest26986-21fschecks_count19:00:123
13045995019,14cyclictest0-21swapper/018:51:190
1305299495,27cyclictest32289-21missed_timers19:10:183
13052994933,10cyclictest23351-21unixbench_singl18:50:293
13052994933,10cyclictest11336-21sed18:25:283
1304599484,28cyclictest0-21swapper/018:25:150
13052994716,24cyclictest18969-21sed17:35:203
13045994732,9cyclictest25387-21find18:55:240
1305299464,24cyclictest14011-21grep17:25:183
1305299463,27cyclictest0-21swapper/318:30:303
1304599464,13cyclictest0-21swapper/018:40:150
13052994530,9cyclictest4551-21hwlatdetect19:20:143
13052994513,24cyclictest30276-21cpuspeed_turbos18:00:113
13052994511,20cyclictest3036-21df_inode18:10:133
1304599453,25cyclictest0-21swapper/017:56:080
13045994517,12cyclictest0-21swapper/017:35:110
13052994414,24cyclictest21513-21latency17:40:203
13052994213,8cyclictest13112-21latency_hist17:25:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional