You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-09 - 11:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Thu Jul 09, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
143411621870,2sleep3481ktimers/323:10:163
1188188996052,6cyclictest1280053-21kworker/u8:0+flush-8:020:50:200
1188188996052,6cyclictest1280053-21kworker/u8:0+flush-8:020:50:200
1188188995954,3cyclictest1419314-21kworker/u8:3+events_unbound00:15:230
1188193995545,7cyclictest1704890-21systemd-journal20:44:592
1188192995540,13cyclictest1399886-21apt-get22:40:011
1188188995547,6cyclictest1410172-21cp22:50:010
1188192995244,6cyclictest1369678-21latency_hist22:10:001
1188188995144,4cyclictest1205156-21kworker/u8:1+flush-8:019:30:050
1188188995140,9cyclictest1155387-21kworker/u8:3+flush-8:020:25:210
1188192995029,6cyclictest1704890-21systemd-journal21:10:091
1188188995045,3cyclictest1294285-21kworker/u8:2+flush-8:023:15:060
1188192994939,8cyclictest1298677-21ntpq20:55:191
1188192994939,8cyclictest1298677-21ntpq20:55:191
1188188994944,4cyclictest1178771-21kworker/u8:2+flush-8:020:05:250
1188188994840,6cyclictest1294285-21kworker/u8:2+flush-8:022:20:050
1188188994738,6cyclictest1425157-21latency_hist23:05:010
1188188994535,8cyclictest1374732-21cp22:15:010
1188188994438,4cyclictest1294285-21kworker/u8:2+events_unbound21:15:060
14008212430,4sleep375-21kworker/3:1+mm_percpu_wq22:40:103
1188192994337,4cyclictest1490111-21apt-get00:10:011
1188192994336,5cyclictest1220297-21/usr/sbin/munin19:40:211
1188188994332,9cyclictest1358847-21ntpq21:55:190
1188188994237,4cyclictest1178771-21kworker/u8:2+flush-8:020:35:220
1188188994232,7cyclictest1414309-21ntpq22:50:170
1188192994134,5cyclictest1214864-21latency_hist19:35:001
1188192994133,6cyclictest1505777-21apt-get00:25:051
1188192994132,7cyclictest1303625-21ntpq21:00:161
1188192994132,6cyclictest1704890-21systemd-journal20:55:001
1188192994132,6cyclictest1704890-21systemd-journal20:54:591
1188192994131,8cyclictest1319506-21cp21:20:001
1188192994030,7cyclictest1500526-21latency_hist00:20:011
1188188994030,8cyclictest1340230-21/usr/sbin/munin21:40:190
1188188993934,3cyclictest1155387-21kworker/u8:3+events_unbound20:40:230
1188188993931,6cyclictest1470192-21latency_hist23:50:000
1188188993925,10cyclictest1704890-21systemd-journal22:05:080
1188193993830,5cyclictest1430468-21base6423:10:012
1188188993833,4cyclictest1314092-21kworker/u8:3+flush-8:022:15:210
1188188993831,5cyclictest1419314-21kworker/u8:3+events_unbound00:05:080
1188188993732,4cyclictest1220568-21kworker/u8:0+flush-8:019:40:190
1188188993731,4cyclictest1419314-21kworker/u8:3+flush-8:023:35:100
1188188993731,4cyclictest1294285-21kworker/u8:2+flush-8:022:30:060
1188188993730,5cyclictest1314092-21kworker/u8:3+flush-8:021:30:190
1188192993630,4cyclictest1350174-21apt-get21:50:041
1188188993632,3cyclictest1514735-21kworker/u8:1+events_unbound00:35:240
1188188993632,3cyclictest1294285-21kworker/u8:2+events_unbound21:45:210
1188188993629,5cyclictest1155387-21kworker/u8:3+flush-8:019:20:210
1188188993628,6cyclictest1360036-21apt-get22:00:040
1188188993627,6cyclictest1430320-21apt-get23:10:010
1188192993528,5cyclictest1475373-21/usr/sbin/munin23:55:171
1188192993526,7cyclictest1333850-21ntpq21:30:181
1188188993530,4cyclictest1205156-21kworker/u8:1+flush-8:019:35:230
1188188993529,4cyclictest1294285-21kworker/u8:2+flush-8:021:00:190
1188188993526,7cyclictest1338809-21ntpq21:35:190
1188188993526,6cyclictest1155387-21kworker/u8:3+flush-8:020:10:210
1188193993428,4cyclictest1464741-21unixbench_multi23:40:252
1188193993427,5cyclictest1320160-21cut21:20:092
1188192993428,3cyclictest1411095-21irqcore22:50:111
1188192993427,5cyclictest1505527-21latency_hist00:25:001
1188192993426,6cyclictest1200195-21apt-get19:20:051
1188188993430,3cyclictest1419314-21kworker/u8:3+flush-8:000:25:250
1188188993430,3cyclictest1280053-21kworker/u8:0+events_unbound21:05:230
1188188993429,3cyclictest1294285-21kworker/u8:2+events_unbound22:35:230
1188188993422,9cyclictest1704890-21systemd-journal00:10:080
1188188993421,10cyclictest1704890-21systemd-journal20:30:080
118818899340,32cyclictest1455275-21munin-run23:35:010
1188193993328,3cyclictest1215134-21apt-config19:35:012
1188192993326,5cyclictest1325062-21apt-get21:25:051
1188192993325,6cyclictest1359767-21latency_hist22:00:021
1188192993321,9cyclictest1704890-21systemd-journal23:00:001
1188188993329,3cyclictest1294285-21kworker/u8:2+events_unbound23:40:230
1188188993327,4cyclictest1155387-21kworker/u8:3+flush-8:020:00:200
1188188993326,5cyclictest1480117-40logrotate00:00:000
1188193993224,6cyclictest1704890-21systemd-journal19:29:082
1188192993227,3cyclictest1450782-21tr23:30:051
1188192993226,4cyclictest1314092-21kworker/u8:3+flush-8:022:10:231
1188192993223,6cyclictest1704890-21systemd-journal20:24:591
1188188993228,3cyclictest1294285-21kworker/u8:2+flush-8:023:11:130
1188188993227,4cyclictest1178771-21kworker/u8:2+flush-8:020:15:090
1188188993227,4cyclictest1178771-21kworker/u8:2+flush-8:019:10:210
12033362310,4sleep3481ktimers/319:20:153
1188193993126,4cyclictest1339771-21sendmail21:40:002
1188192993127,3cyclictest1195948-21irqrtprio19:15:141
1188192993126,4cyclictest1155387-21kworker/u8:3+events_unbound20:40:001
1188192993124,5cyclictest1188316-21apt-get19:10:041
1188192993122,7cyclictest1704890-21systemd-journal20:35:001
1188188993127,3cyclictest1314092-21kworker/u8:3+events_unbound21:25:090
1188188993127,3cyclictest1294285-21kworker/u8:2+events_unbound22:55:180
1188188993127,3cyclictest1178771-21kworker/u8:2+events_unbound19:55:090
1188188993127,3cyclictest1155387-21kworker/u8:3+events_unbound19:45:090
1188188993126,4cyclictest1419314-21kworker/u8:3+events_unbound23:25:220
1188188993125,4cyclictest1155387-21kworker/u8:3+flush-8:020:45:080
1188193993020,8cyclictest1504586-21ntpq00:20:152
1188192993023,5cyclictest1515632-21apt-get00:35:041
1188192993023,5cyclictest1515194-40mandb00:32:531
1188192993023,5cyclictest1515194-40mandb00:32:521
1188192993020,7cyclictest1704890-21systemd-journal23:15:081
1188188993025,3cyclictest1295190-21cut20:55:100
1188188993025,3cyclictest1295190-21cut20:55:090
1188188993020,7cyclictest1444470-21ntpq23:20:190
1188193992925,2cyclictest1309853-21aten2_r5power_p21:10:062
1188192992925,3cyclictest1155387-21kworker/u8:3+flush-8:019:35:371
1188192992924,3cyclictest1237346-21kthreadcore19:55:141
1188192992923,4cyclictest1284753-21latency_hist20:45:001
1188188992925,3cyclictest1419314-21kworker/u8:3+events_unbound00:20:220
1188188992924,3cyclictest1269433-21kworker/u8:1+events_unbound21:10:190
1188188992919,7cyclictest1324576-21latency_hist21:25:010
1188192992824,2cyclictest1469685-21runrttasks23:45:261
1188192992822,4cyclictest1490116-21turbostat.cron00:09:591
1188192992822,4cyclictest1455504-21apt-get23:35:051
1188192992822,4cyclictest1319894-21apt-get21:20:051
1188192992821,5cyclictest1470440-21apt-get23:50:051
1188188992824,3cyclictest1294285-21kworker/u8:2+events_unbound22:40:200
1188193992723,2cyclictest1515746-21aten2_r5power_v00:35:062
1188193992723,2cyclictest1360066-21aten2_r5power_c22:00:062
1188193992722,3cyclictest1449906-21unixbench_singl23:25:252
1188193992721,4cyclictest1474679-21unixbench_multi23:50:252
118819299276,13cyclictest0-21swapper/123:01:561
1188192992720,5cyclictest1464753-21grep23:40:251
1188192992720,5cyclictest1155387-21kworker/u8:3+flush-8:020:13:391
1188192992719,6cyclictest1425160-21apt-get23:05:011
1188192992718,7cyclictest1704890-21systemd-journal23:11:091
1188192992718,6cyclictest1155387-21kworker/u8:3+flush-8:019:25:231
1188188992721,5cyclictest1465775-21kworker/u8:0+flush-8:000:00:200
1188188992720,5cyclictest1419314-21kworker/u8:3+flush-8:023:50:190
1188193992621,3cyclictest1250343-21fschecks_count20:10:092
1188193992620,4cyclictest589-21runrttasks20:55:092
1188193992620,4cyclictest589-21runrttasks20:55:082
1188192992620,4cyclictest0-21swapper/122:35:011
1188188992622,3cyclictest1294285-21kworker/u8:2+events_unbound00:30:250
1188188992622,3cyclictest1294285-21kworker/u8:2+events_unbound00:30:240
1188188992619,4cyclictest1178771-21kworker/u8:2+events_unbound20:20:230
118818899261,23cyclictest1193432-21irqcore19:15:030
1188193992521,2cyclictest0-21swapper/200:09:592
1188193992517,5cyclictest1495717-21cat00:15:012
118819299257,5cyclictest0-21swapper/122:17:551
1188192992521,3cyclictest1269433-21kworker/u8:1+flush-8:021:06:291
1188192992521,2cyclictest0-21swapper/119:45:091
1188192992519,4cyclictest1244510-21journal-offline20:00:431
1188192992517,6cyclictest1339751-21apt-get21:40:001
1188188992520,3cyclictest1234480-21unixbench_multi19:50:230
1188193992420,2cyclictest1340313-21aten2_r5power_e21:40:062
1188193992420,2cyclictest1285119-21aten2_r5power_v20:45:062
1188193992420,2cyclictest0-21swapper/221:20:012
1188193992420,2cyclictest0-21swapper/219:20:002
1188193992419,3cyclictest1325280-21cpuspeed_turbos21:25:082
118819299248,5cyclictest0-21swapper/120:25:261
1188192992420,2cyclictest0-21swapper/123:20:081
1188192992420,2cyclictest0-21swapper/122:49:091
1188192992420,2cyclictest0-21swapper/122:20:221
1188192992419,3cyclictest0-21swapper/121:45:261
1188188992420,3cyclictest1350765-21sort21:50:110
1188188992419,4cyclictest1155387-21kworker/u8:3+flush-8:019:25:310
1188193992319,3cyclictest1510772-21aten2_r5power_p00:30:082
1188193992319,3cyclictest1510772-21aten2_r5power_p00:30:082
1188193992319,2cyclictest1450650-21aten2_r5power_p23:30:042
1188193992319,2cyclictest1405642-21fschecks_count22:45:092
1188193992318,3cyclictest1415267-21sh22:55:002
1188193992314,7cyclictest1379857-21awk22:20:012
118819299237,4cyclictest0-21swapper/120:18:401
118819299235,5cyclictest0-21swapper/120:07:391
1188188992316,5cyclictest1385374-21tune2fs22:25:080
11876592233,3sleep00-21swapper/019:05:450
118819399223,13cyclictest1245111-21apt-get20:05:082
1188193992218,2cyclictest0-21swapper/223:05:002
1188193992216,4cyclictest1369669-21turbostat.cron22:10:012
1188192992218,2cyclictest0-21swapper/122:40:051
1188192992218,2cyclictest0-21swapper/122:25:151
1188192992217,4cyclictest1449909-21unixbench_singl23:25:251
1188192992217,2cyclictest0-21swapper/122:00:231
1188193992112,7cyclictest1389870-21sed22:30:002
1188192992117,2cyclictest0-21swapper/119:50:101
1188192992117,2cyclictest0-21swapper/100:00:081
118819299211,6cyclictest1344082-21ntpq21:40:181
1188192992116,3cyclictest0-21swapper/120:45:041
11877272214,11sleep10-21swapper/119:06:391
1188193992017,2cyclictest1334767-21cron21:35:012
1188193992013,5cyclictest1704890-21systemd-journal21:55:012
1188193992012,6cyclictest1444917-21sed23:20:262
1188193992012,6cyclictest1278812-21awk20:35:182
1188193992011,7cyclictest1235945-21sed19:55:122
1188193992011,7cyclictest1226304-21cut19:45:142
1188193992010,8cyclictest1704890-21systemd-journal19:40:002
1188193992010,8cyclictest1704890-21systemd-journal19:23:082
1188193992010,7cyclictest1400241-21dpkg22:40:012
118819399192,12cyclictest1369927-21apt-get22:10:052
1188193991916,2cyclictest1484648-21unixbench_multi00:00:242
1188193991916,2cyclictest1465577-21aten2_r5power_v23:45:092
1188193991915,2cyclictest0-21swapper/222:30:222
1188193991915,2cyclictest0-21swapper/200:15:192
1188193991913,4cyclictest0-21swapper/223:15:152
1188193991911,6cyclictest1259466-21awk20:15:252
11839082193,9sleep30-21swapper/319:05:113
1188193991815,2cyclictest1400421-21aten2_r5power_c22:40:052
1188193991814,3cyclictest0-21swapper/223:39:592
1188193991814,2cyclictest0-21swapper/223:10:242
1188193991814,2cyclictest0-21swapper/220:30:102
1188193991814,2cyclictest0-21swapper/220:20:072
1188193991814,2cyclictest0-21swapper/200:00:002
1188193991813,3cyclictest0-21swapper/221:45:072
1188193991811,5cyclictest1192394-21grep19:10:242
13061672170,3sleep20-21swapper/221:05:132
118819399173,10cyclictest1293709-21ntpq20:50:192
118819399173,10cyclictest1293709-21ntpq20:50:182
1188193991714,2cyclictest1358535-21tr21:55:152
1188193991713,2cyclictest0-21swapper/221:00:232
1188193991713,2cyclictest0-21swapper/219:50:202
1188193991712,3cyclictest0-21swapper/222:55:152
1188193991712,3cyclictest0-21swapper/220:00:252
11876332174,9sleep20-21swapper/219:05:272
118819399167,7cyclictest1509127-21tr00:25:162
118819399162,5cyclictest0-21swapper/222:22:212
1188193991611,3cyclictest0-21swapper/219:40:102
118819399159,3cyclictest1266727-21grep20:25:132
12419812145,5sleep30-21swapper/320:00:143
14703852132,6sleep30-21swapper/323:50:013
14658442134,6sleep30-21swapper/323:45:123
14557482132,7sleep30-21swapper/323:35:083
14303102132,7sleep30-21swapper/323:10:003
14054222132,7sleep30-21swapper/322:45:083
13848172132,6sleep30-21swapper/322:25:023
12887602132,7sleep30-21swapper/320:45:163
12351472132,7sleep30-21swapper/319:55:043
12349062132,7sleep30-21swapper/319:55:003
15200692123,5sleep30-21swapper/300:36:093
15143772121,7sleep30-21swapper/300:30:193
15143772121,7sleep30-21swapper/300:30:183
15018732122,6sleep30-21swapper/300:20:123
14872212122,6sleep30-21swapper/300:05:153
14801472122,5sleep30-21swapper/300:00:013
14604732123,5sleep30-21swapper/323:40:033
14508132122,6sleep30-21swapper/323:30:083
14454292122,5sleep30-21swapper/323:25:023
14407052122,6sleep30-21swapper/323:20:073
14202162122,5sleep30-21swapper/323:00:013
14104422122,5sleep30-21swapper/322:50:013
13946822120,6sleep30-21swapper/322:35:003
13803682122,6sleep30-21swapper/322:20:093
13598032122,6sleep30-21swapper/322:00:023
13551672122,6sleep30-21swapper/321:55:073
13505212123,6sleep30-21swapper/321:50:113
13403222123,6sleep30-21swapper/321:40:063
13344522122,6sleep30-21swapper/321:31:043
13246922121,6sleep30-21swapper/321:25:013
13136172122,6sleep30-21swapper/321:10:223
13048362122,6sleep30-21swapper/321:05:073
13012942122,6sleep30-21swapper/321:00:143
12987042122,6sleep30-21swapper/320:55:213
12987042122,6sleep30-21swapper/320:55:203
12946302122,6sleep30-21swapper/320:55:003
12946302122,6sleep30-21swapper/320:55:003
12700182122,6sleep30-21swapper/320:30:033
12654842122,6sleep30-21swapper/320:25:103
12642602122,6sleep30-21swapper/320:20:253
12595502122,6sleep30-21swapper/320:15:403
12498232122,5sleep30-21swapper/320:10:013
12149812122,6sleep30-21swapper/319:35:013
12142262122,6sleep30-21swapper/319:30:253
11932992122,6sleep30-21swapper/319:15:043
15055492112,5sleep30-21swapper/300:25:013
14958192112,6sleep30-21swapper/300:15:063
14905742112,5sleep30-21swapper/300:10:043
14754412112,5sleep30-21swapper/323:55:073
14357132112,5sleep30-21swapper/323:15:033
14155282112,6sleep30-21swapper/322:55:083
13951562112,5sleep30-21swapper/322:35:053
13754762112,6sleep30-21swapper/322:15:103
13701722112,5sleep30-21swapper/322:10:093
13653492112,5sleep30-21swapper/322:05:123
13459502112,5sleep30-21swapper/321:45:133
13349992112,5sleep30-21swapper/321:35:063
13238602112,6sleep30-21swapper/321:20:243
13147082112,5sleep30-21swapper/321:15:073
12827622112,5sleep30-21swapper/320:40:163
12748722112,5sleep30-21swapper/320:35:023
12450942112,6sleep30-21swapper/320:05:083
12252582112,5sleep30-21swapper/319:45:053
12241882112,5sleep30-21swapper/319:40:203
12051222112,5sleep30-21swapper/319:25:033
11880172112,5sleep30-21swapper/319:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional