You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-11 - 11:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Fri Sep 11, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
152189322140,6sleep30-21swapper/323:59:103
15158762730,3sleep375-21kworker/3:1-events23:49:233
12653612610,4sleep00-21swapper/019:39:120
13220602570,1chrt1322061-21/usr/sbin/munin20:34:221
1236184995448,5cyclictest3971911-21kworker/u8:2+events_unbound19:14:341
1236183994236,4cyclictest278-21systemd-journal23:09:160
1236184994135,4cyclictest1278517-21apt-get19:54:031
1236184994031,7cyclictest1530890-21latency_hist00:05:021
1236183994035,4cyclictest1226274-21kworker/u8:3+flush-8:019:20:000
123618399400,38cyclictest1-21systemd21:05:000
1236184993933,4cyclictest1338059-21apt-get20:54:041
1236183993932,5cyclictest278-21systemd-journal22:40:010
12313852384,10sleep10-21swapper/119:05:071
1236184993732,4cyclictest1322447-21kworker/u8:0+events_unbound21:14:251
1236184993729,6cyclictest1263644-21/usr/sbin/munin19:39:211
1236183993732,4cyclictest1248226-21kworker/u8:0+flush-8:019:44:080
1236183993631,3cyclictest1555995-21latency_hist00:30:000
1236184993530,4cyclictest1292965-21kworker/u8:1+flush-8:020:14:091
1236184993529,4cyclictest1526186-21kworker/u8:3+flush-8:000:19:251
123618399354,27cyclictest1216269-21kworker/0:2+events21:25:430
1236183993529,4cyclictest1322447-21kworker/u8:0+events_unbound21:39:130
1236183993529,4cyclictest1253087-21gpgv19:25:000
1236183993526,6cyclictest1372128-21latency_hist21:25:000
1236183993526,6cyclictest1372128-21latency_hist21:25:000
1236189993426,6cyclictest278-21systemd-journal22:25:002
1236189993426,6cyclictest278-21systemd-journal22:25:002
1236184993425,6cyclictest278-21systemd-journal23:04:161
1236184993329,2cyclictest1333233-21aten2_r5power_p20:49:051
1236184993328,4cyclictest1292965-21kworker/u8:1+flush-8:020:09:091
1236184993328,3cyclictest1497520-21irqrtprio23:34:101
1236184993328,3cyclictest1497520-21irqrtprio23:34:101
1236184993325,6cyclictest1347380-21cron21:00:011
1236184993228,3cyclictest1346841-21kworker/u8:1+flush-8:021:29:101
1236184993223,7cyclictest1446294-21latency_hist22:40:011
1236184993223,6cyclictest1268600-21/usr/sbin/munin19:44:181
1236184993222,8cyclictest1287157-21ntpq19:59:161
1236183993227,3cyclictest1358592-21irqrtprio21:14:120
1236184993125,4cyclictest1535819-21apt-get00:10:031
1236184993123,6cyclictest1447105-21apt-get22:44:041
1236184993120,9cyclictest1561798-21apt-get00:39:031
1236183993125,4cyclictest1236653-21apt-get19:14:010
1236183993122,3cyclictest1387778-21df21:44:080
13671902300,9sleep1291ktimers/121:20:001
1236189993026,2cyclictest1263888-21cpuspeed_turbos19:39:062
1236184993025,4cyclictest1346841-21kworker/u8:1+events_unbound21:24:181
1236184993025,4cyclictest1346841-21kworker/u8:1+events_unbound21:24:181
1236184993024,4cyclictest1226274-21kworker/u8:3+flush-8:019:19:141
1236184993024,2cyclictest0-21swapper/122:19:111
1236184993023,6cyclictest1481171-21kworker/u8:3+flush-8:023:24:161
1236184993021,6cyclictest278-21systemd-journal20:35:161
1236183993025,3cyclictest1526186-21kworker/u8:3+events_unbound00:35:000
1236184992926,2cyclictest1512347-21irqrtprio23:49:111
1236184992924,3cyclictest1535813-21idleruntime-cro00:10:001
1236184992924,3cyclictest1406622-21unixbench_singl21:59:241
1236184992923,5cyclictest1377090-21kworker/u8:3+events_unbound22:04:151
1236184992923,4cyclictest1263128-21kworker/u8:3+events_unbound20:44:211
1236184992922,5cyclictest1457021-21apt-get22:54:061
1236184992921,6cyclictest1421563-21latency_hist22:15:001
1236184992920,7cyclictest1436958-21apt-get22:34:041
1236183992925,3cyclictest1456382-21unixbench_singl22:49:240
1236183992922,6cyclictest1292965-21kworker/u8:1+flush-8:020:09:210
1236189992825,2cyclictest1516615-21aten2_r5power_c23:54:052
1236189992819,7cyclictest278-21systemd-journal21:29:162
1236184992823,4cyclictest1471279-21kworker/u8:0+flush-8:023:14:191
1236184992821,4cyclictest1263005-21unixbench_singl19:34:221
1236184992816,8cyclictest278-21systemd-journal21:35:001
1236189992723,2cyclictest1328482-21fschecks_count20:44:082
1236189992721,4cyclictest1525901-21sendmail00:00:002
1236189992718,7cyclictest1252981-21apt-get19:24:592
1236184992722,3cyclictest1253173-21apt-key19:25:001
1236184992721,4cyclictest1446123-21kworker/u8:1+events_unbound23:00:001
1236184992721,3cyclictest0-21swapper/121:04:211
1236184992720,5cyclictest1387207-21kworker/u8:2+flush-8:022:09:231
1236184992720,5cyclictest1292738-21latency_hist20:05:011
1236184992715,8cyclictest278-21systemd-journal21:10:001
1236183992723,3cyclictest1426546-21systemd-run22:20:000
1236183992722,4cyclictest1471279-21kworker/u8:0+events_unbound23:39:250
1236183992722,3cyclictest1387207-21kworker/u8:2+flush-8:022:09:100
1236183992718,7cyclictest1312546-21latency_hist20:25:000
12481562260,6sleep20-21swapper/219:20:002
1236189992623,2cyclictest1546844-21fschecks_time00:24:082
1236189992623,2cyclictest1337386-21unixbench_singl20:49:232
1236189992623,2cyclictest1293357-21aten2_r5power_e20:09:062
1236184992620,3cyclictest0-21swapper/123:09:121
1236184992618,5cyclictest0-21swapper/121:45:011
1236184992617,7cyclictest278-21systemd-journal00:35:001
1236184992612,10cyclictest278-21systemd-journal21:55:001
123618399267,18cyclictest1216269-21kworker/0:2+events19:59:520
1236183992623,2cyclictest1492154-21fschecks_count23:29:070
1236183992622,3cyclictest1530872-21cron00:05:000
123618399262,19cyclictest1471299-21kworker/0:1+events23:55:030
1236183992619,5cyclictest1471262-21latency_hist23:05:010
123618399261,24cyclictest1471299-21kworker/0:1+events23:24:120
1236189992522,2cyclictest1466212-21unixbench_singl22:59:282
1236189992522,2cyclictest1307641-21sendmail20:20:012
1236189992522,2cyclictest1307641-21sendmail20:20:002
1236189992520,4cyclictest1545965-21idleruntime-cro00:20:002
123618499252,16cyclictest1547255-21sed00:24:111
1236184992520,4cyclictest1263128-21kworker/u8:3+events_unbound20:29:091
1236184992519,4cyclictest1426464-21kworker/u8:0+flush-8:022:24:121
1236184992519,4cyclictest1426464-21kworker/u8:0+flush-8:022:24:121
1236184992518,5cyclictest1377090-21kworker/u8:3+events_unbound21:49:181
1236184992515,7cyclictest1525911-40logrotate00:00:001
1236184992511,10cyclictest278-21systemd-journal23:39:161
123618399256,18cyclictest1387000-21kworker/0:0+events22:29:110
123618399255,19cyclictest1216269-21kworker/0:2+events21:18:310
1236183992522,2cyclictest1481078-21unixbench_singl23:14:240
123618399252,22cyclictest1216269-21kworker/0:2+events20:13:160
1236183992521,3cyclictest0-21swapper/000:15:000
1236183992520,4cyclictest1347307-21unixbench_singl20:59:240
1236183992520,4cyclictest0-21swapper/023:49:160
1236183992520,3cyclictest1501063-21unixbench_singl23:34:240
1236183992520,3cyclictest1501063-21unixbench_singl23:34:230
1236183992520,3cyclictest1327511-21unixbench_singl20:39:230
1236189992421,2cyclictest1526804-21fschecks_time00:04:102
1236189992421,2cyclictest1367109-21unixbench_singl21:19:222
1236189992420,2cyclictest1476862-21aten2_r5power_e23:14:062
1236189992416,6cyclictest1566257-21cat00:40:002
1236184992419,3cyclictest1-21systemd19:50:011
1236184992419,3cyclictest0-21swapper/123:45:011
1236184992419,2cyclictest0-21swapper/100:29:231
1236184992418,4cyclictest1481171-21kworker/u8:3+events_unbound23:29:181
1236184992418,4cyclictest1387207-21kworker/u8:2+events_unbound22:49:241
1236184992418,4cyclictest1308424-21cpuspeed_turbos20:24:081
1236184992418,3cyclictest0-21swapper/123:19:031
1236184992418,2cyclictest0-21swapper/121:39:081
1236184992417,5cyclictest1263128-21kworker/u8:3+flush-8:020:19:181
1236184992417,5cyclictest1263128-21kworker/u8:3+flush-8:020:19:181
123618399245,2cyclictest161rcu_preempt19:34:080
123618399242,18cyclictest1387000-21kworker/0:0+events22:11:070
1236183992420,3cyclictest1532172-21grep00:09:120
1236183992419,3cyclictest1461287-21unixbench_singl22:54:250
1236183992419,3cyclictest0-21swapper/019:49:060
1236183992415,7cyclictest1377603-21/usr/sbin/munin21:34:160
123618399241,22cyclictest1216269-21kworker/0:2+events19:29:030
12316032243,3sleep00-21swapper/019:07:550
14060612230,6chrt0-21swapper/221:59:182
1236189992319,3cyclictest1298629-21fschecks_time20:14:092
1236189992319,2cyclictest1432371-21fschecks_time22:29:082
1236189992319,2cyclictest1313328-21cpuspeed_turbos20:29:062
1236189992319,2cyclictest0-21swapper/221:40:002
1236189992318,4cyclictest1421570-21apt22:15:012
1236189992314,2cyclictest0-21swapper/223:40:012
123618499232,15cyclictest1254493-21irqrtprio19:29:101
123618399236,16cyclictest1387000-21kworker/0:0+events22:34:070
123618399236,16cyclictest1216269-21kworker/0:2+events20:34:030
123618399234,18cyclictest1216269-21kworker/0:2+events20:47:110
1236183992321,1cyclictest0-21swapper/022:24:200
1236183992321,1cyclictest0-21swapper/022:24:200
1236183992319,2cyclictest0-21swapper/000:20:000
1236183992318,3cyclictest0-21swapper/020:19:230
1236183992318,3cyclictest0-21swapper/020:19:230
1236183992317,5cyclictest1486004-21unixbench_singl23:19:230
1236183992317,4cyclictest1447355-21diskstats22:44:080
1236183992313,7cyclictest278-21systemd-journal23:00:000
13269872220,5sleep20-21swapper/220:39:162
1236189992219,2cyclictest1253859-21aten2_r5power_p19:29:052
123618399226,15cyclictest1387000-21kworker/0:0+events21:54:030
123618399224,17cyclictest1387000-21kworker/0:0+events21:59:070
1236183992218,2cyclictest0-21swapper/020:04:120
1236183992217,3cyclictest0-21swapper/020:29:130
1236183992217,3cyclictest0-21swapper/000:25:000
1236183992215,6cyclictest1353066-21aten2_r5power_v21:09:050
1236183992215,5cyclictest1331950-21ntpq20:44:170
1236183992212,8cyclictest1520379-21ntpq23:54:160
123618999214,2cyclictest13099912grep20:24:142
1236189992118,2cyclictest1536878-21fschecks_count00:14:082
1236189992118,2cyclictest1259062-21fschecks_time19:34:072
1236189992118,2cyclictest1236767-21aten2_r5power_v19:14:042
1236189992117,2cyclictest0-21swapper/223:20:002
1236189992116,3cyclictest1362235-21cron21:15:002
1236189992115,4cyclictest1496237-21turbostat.cron23:30:012
1236189992115,4cyclictest0-21swapper/200:30:002
1236189992112,7cyclictest1536248-21cut00:10:012
123618999210,9cyclictest14250832grep22:19:142
1236183992119,1cyclictest0-21swapper/022:04:200
1236183992117,3cyclictest1338778-21tr20:54:110
1236183992117,2cyclictest0-21swapper/000:39:120
1236183992114,6cyclictest1510917-21unixbench_multi23:44:240
1236183992114,6cyclictest1278807-21fschecks_count19:54:070
1236189992017,2cyclictest1556922-21fschecks_count00:34:082
1236189992017,2cyclictest1487192-21fschecks_count23:24:062
1236189992016,3cyclictest1456453-21idleruntime-cro22:50:002
1236189992016,3cyclictest1318331-21fschecks_count20:34:082
1236189992016,2cyclictest1507043-21fschecks_time23:44:092
1236189992016,2cyclictest0-21swapper/221:00:002
1236189992011,7cyclictest1394263-21tr21:49:142
1236184992014,4cyclictest1432244-21cut22:29:061
1236184992014,3cyclictest0-21swapper/123:54:091
1236183992011,7cyclictest1394083-21cut21:49:140
12312392203,8sleep30-21swapper/319:05:013
1236189991915,3cyclictest0-21swapper/222:10:002
1236189991914,3cyclictest0-21swapper/220:55:002
12321712194,9sleep20-21swapper/219:09:102
1236189991814,2cyclictest0-21swapper/221:44:142
1236189991814,2cyclictest0-21swapper/219:54:172
1236189991813,3cyclictest0-21swapper/222:05:002
1236189991811,5cyclictest1476231-21cron23:10:002
1236189991811,5cyclictest1272987-21cron19:45:002
1236189991810,6cyclictest1368093-21fschecks_time21:24:092
1236189991810,6cyclictest1368093-21fschecks_time21:24:092
123618999178,7cyclictest278-21systemd-journal21:05:002
123618999178,7cyclictest1290660-21tr20:04:132
123618999178,7cyclictest1285056-21tr19:59:122
123618999172,10cyclictest1352953-21apt-get21:09:042
1236189991713,2cyclictest0-21swapper/223:50:012
123618999170,5cyclictest1248226-21kworker/u8:0+flush-8:019:45:062
123618999170,3cyclictest1445737-21ntp_states22:39:192
13875452162,8sleep30-21swapper/321:44:063
13351652160,6sleep375-21kworker/3:1+mm_percpu_wq20:49:133
123618999166,8cyclictest1500333-21grep23:34:142
123618999166,8cyclictest1500333-21grep23:34:142
1236189991613,2cyclictest0-21swapper/222:52:322
1236189991611,3cyclictest0-21swapper/222:34:122
1236189991610,4cyclictest0-21swapper/221:54:132
12436082151,8sleep30-21swapper/319:19:063
123618999155,8cyclictest1377846-21tr21:34:072
123618999152,2cyclictest0-21swapper/222:41:112
1236189991512,2cyclictest0-21swapper/223:04:092
13587132145,5sleep30-21swapper/321:14:133
13420882144,6sleep30-21swapper/320:54:233
15459912132,6sleep30-21swapper/300:20:013
14912882132,6sleep30-21swapper/323:25:013
14662912132,6sleep30-21swapper/323:00:013
14413172132,6sleep30-21swapper/322:35:013
14265382132,6sleep30-21swapper/322:20:013
14265382132,6sleep30-21swapper/322:20:013
14018012132,6sleep30-21swapper/321:55:013
13947712134,5sleep30-21swapper/321:49:163
13816372130,3sleep30-21swapper/321:34:223
13090822132,7sleep30-21swapper/320:24:143
12828542132,6sleep30-21swapper/319:55:013
15623242122,6sleep30-21swapper/300:39:113
15455792122,6sleep30-21swapper/300:19:253
15296802122,6sleep30-21swapper/300:04:163
15165882122,6sleep30-21swapper/323:54:053
15061732122,6sleep30-21swapper/323:40:013
15004542122,6sleep30-21swapper/323:34:153
15004542122,6sleep30-21swapper/323:34:153
14822132122,6sleep30-21swapper/323:19:113
14776872122,6sleep30-21swapper/323:14:133
14628332122,6sleep30-21swapper/322:59:183
14574122122,6sleep30-21swapper/322:54:113
14518232122,6sleep30-21swapper/322:46:173
14372072122,6sleep30-21swapper/322:34:093
14318392123,6sleep30-21swapper/322:27:033
14259722123,5sleep30-21swapper/322:19:213
14209752122,6sleep30-21swapper/322:14:193
13989422122,6sleep30-21swapper/321:54:133
13861652122,6sleep30-21swapper/321:39:163
13622712122,6sleep30-21swapper/321:15:023
13427072124,5sleep30-21swapper/320:55:233
13224012120,7sleep30-21swapper/320:35:013
13004212122,6sleep30-21swapper/320:14:153
12922232122,6sleep30-21swapper/320:04:203
12785202122,6sleep30-21swapper/319:54:053
12741122122,6sleep30-21swapper/319:49:113
12708182123,6sleep30-21swapper/319:44:143
12581342122,6sleep30-21swapper/319:30:013
12409582122,6sleep30-21swapper/319:14:373
15563822112,6sleep30-21swapper/300:31:133
15512342112,6sleep30-21swapper/300:26:233
15363552112,6sleep30-21swapper/300:11:063
15311202112,6sleep30-21swapper/300:05:143
15016242112,6sleep30-21swapper/323:37:563
14916242112,6sleep30-21swapper/323:26:173
14714952112,6sleep30-21swapper/323:05:113
14467722112,6sleep30-21swapper/322:40:083
14119612112,6sleep30-21swapper/322:06:093
14069702112,6sleep30-21swapper/322:00:113
13724552112,6sleep30-21swapper/321:26:213
13674862112,5sleep30-21swapper/321:20:393
13674862112,5sleep30-21swapper/321:20:393
13527332113,5sleep30-21swapper/321:06:313
13476382112,6sleep30-21swapper/321:00:063
13280182112,6sleep30-21swapper/320:42:113
13229092112,6sleep30-21swapper/320:35:293
13129392112,6sleep30-21swapper/320:27:153
13029782112,6sleep30-21swapper/320:16:193
13029782112,6sleep30-21swapper/320:16:193
12931092112,6sleep30-21swapper/320:06:563
12633432112,6sleep30-21swapper/319:35:113
12536002112,6sleep30-21swapper/319:27:083
12484562112,6sleep30-21swapper/319:23:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional