You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-28 - 16:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sun Jun 28, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13998602600,4chrt0-21swapper/008:40:000
13998602600,4chrt0-21swapper/008:40:000
1308315995751,4cyclictest4147736-21kworker/u8:4+flush-8:007:55:311
1308313995544,8cyclictest1542967-21ntpq11:00:230
1308313995544,8cyclictest1542967-21ntpq11:00:230
15342152540,4sleep375-21kworker/3:1+mm_percpu_wq10:55:123
1308313995434,17cyclictest1384020-21ntpq08:20:260
1308315995343,7cyclictest1638497-21latency_hist12:40:021
1308313995137,12cyclictest1504405-21apt-get10:25:120
1308313994940,7cyclictest1359908-21apt-get08:00:000
1308313994940,6cyclictest1313235-21latency_hist07:15:010
1308318994838,8cyclictest1704890-21systemd-journal08:40:002
1308318994838,8cyclictest1704890-21systemd-journal08:39:592
1308313994841,5cyclictest1704890-21systemd-journal11:30:500
1308315994738,7cyclictest1350300-21/usr/sbin/munin07:50:251
1308315994735,9cyclictest1704890-21systemd-journal12:05:271
1308313994737,7cyclictest1369125-21ntpq08:05:250
1308313994726,18cyclictest1554421-21aten2_r5power_p11:15:160
1308315994538,5cyclictest1704890-21systemd-journal09:15:191
1308315994529,13cyclictest1704890-21systemd-journal09:42:271
1308315994529,13cyclictest1519108-21latency_hist10:40:011
1308313994527,15cyclictest1448455-21ntpq09:25:250
1308313994513,10cyclictest1628478-21sshd12:29:260
1308315994435,7cyclictest1308158-21kworker/u8:0+flush-8:007:25:261
130831599440,42cyclictest1-21systemd09:35:011
1308313994436,5cyclictest1389899-21latency_hist08:30:010
1308315994336,5cyclictest1494186-21latency_hist10:15:001
1308315994327,13cyclictest1704890-21systemd-journal11:47:261
1308313994320,8cyclictest1349113-21ntpq07:45:260
1308315994230,9cyclictest1704890-21systemd-journal09:49:271
1308313994236,4cyclictest1704890-21systemd-journal07:31:270
130831399422,11cyclictest1410019-21chrt08:50:160
1308313994219,3cyclictest1430332-21tr09:10:200
16010202410,2sleep375-21kworker/3:1+mm_percpu_wq12:00:213
16010202410,2sleep375-21kworker/3:1+mm_percpu_wq12:00:203
13478082410,5chrt30-21ksoftirqd/107:45:231
1308318994134,5cyclictest1483111-21journal-offline10:00:272
1308315994130,9cyclictest1593902-21cron11:55:001
1308313994124,15cyclictest1474669-21fschecks_count09:55:170
130831399412,17cyclictest583-21snmpd10:55:120
1308313994121,6cyclictest1423575-21grep09:00:260
1308313994120,2cyclictest0-21swapper/010:50:330
1308313994120,19cyclictest1464604-21aten2_r5power_v09:45:160
130831399411,18cyclictest1459010-21sshd09:36:260
1308315994012,16cyclictest0-21swapper/112:10:151
1308313994029,8cyclictest1704890-21systemd-journal12:09:590
1308313994020,18cyclictest1494217-21latency_hist10:15:010
1308315993929,8cyclictest1704890-21systemd-journal10:29:591
1308313993922,14cyclictest1594409-21cpuspeed_turbos11:55:140
130831399392,13cyclictest583-21snmpd07:35:300
1308313993917,6cyclictest1584047-21latency_hist11:45:000
1308313993917,2cyclictest0-21swapper/012:20:330
1308313993917,2cyclictest0-21swapper/007:20:170
1308313993915,3cyclictest0-21swapper/008:40:240
1308318993829,7cyclictest1704890-21systemd-journal07:55:002
1308318993824,12cyclictest1513097-21tail10:30:262
1308318993823,13cyclictest1609079-21aten2_r5power_e12:10:142
1308318993822,14cyclictest1563955-21turbostat.cron11:25:002
1308315993829,7cyclictest1374120-21ntpq08:10:271
1308315993825,11cyclictest1543912-21cron11:05:001
1308315993825,11cyclictest1543912-21cron11:04:591
1308315993821,14cyclictest1365122-21latency_hist08:05:001
1308313993819,3cyclictest1548105-21needreboot11:05:240
1308313993819,2cyclictest0-21swapper/007:44:590
1308313993817,4cyclictest1591413-21tr11:50:240
1308313993815,7cyclictest1704890-21systemd-journal09:35:000
1308313993815,3cyclictest0-21swapper/012:00:230
1308313993815,3cyclictest0-21swapper/012:00:230
130831599373,20cyclictest1315849-21if_enp4s007:15:211
1308315993729,6cyclictest1414663-21latency_hist08:55:021
1308315993723,12cyclictest1320374-21apt-get07:20:141
1308313993727,8cyclictest1553120-21ntpq11:10:250
130831399371,8cyclictest1578663-21unixbench_singl11:35:360
1308313993718,2cyclictest0-21swapper/008:55:310
130831399371,7cyclictest1503264-21ntpq10:20:260
1308313993717,2cyclictest0-21swapper/009:40:210
1308313993715,6cyclictest1483662-21unixbench_singl10:00:350
13034472373,26sleep01303473-21apt-get07:05:130
130831899367,3cyclictest0-21swapper/211:35:212
1308318993628,6cyclictest1704890-21systemd-journal11:30:002
1308315993623,10cyclictest1434120-21unixbench_singl09:10:331
130831599360,9cyclictest1439867-21aten2_r5power_v09:20:151
1308313993627,7cyclictest1408848-21ntpq08:45:290
130831399362,14cyclictest1488296-21sshd10:05:260
1308313993619,6cyclictest1704890-21systemd-journal12:15:590
1308313993618,3cyclictest0-21swapper/009:20:150
1308313993615,3cyclictest0-21swapper/008:15:150
1308313993615,2cyclictest0-21swapper/010:15:290
130831399361,13cyclictest583-21snmpd07:25:140
1308315993524,9cyclictest0-21swapper/112:30:221
1308313993527,6cyclictest1613699-21latency_hist12:15:020
130831399351,14cyclictest1361140-21sed08:00:210
130831399350,33cyclictest1354988-21true07:55:000
1308318993428,4cyclictest1449008-21unixbench_singl09:25:322
130831899342,14cyclictest1494445-21apt-get10:15:132
130831899341,4cyclictest1413739-21ntpq08:50:282
130831599343,25cyclictest0-21swapper/109:05:151
130831599343,15cyclictest0-21swapper/110:30:231
1308315993422,10cyclictest1569159-21cron11:29:591
13078382344,10sleep10-21swapper/107:06:271
1308318993323,8cyclictest1704890-21systemd-journal07:56:272
1308315993314,17cyclictest1484773-21cpuspeed_turbos10:05:151
15115172320,3sleep0201rcuc/010:30:250
1308318993227,3cyclictest1439975-21cpuspeed_turbos09:20:152
1308318993212,3cyclictest0-21swapper/209:00:272
130831599325,19cyclictest0-21swapper/112:28:251
1308315993222,8cyclictest1519643-21diskstats10:40:171
130831599322,26cyclictest1334234-21ntpq07:30:291
1308315993218,12cyclictest1365610-21cpuspeed_turbos08:05:161
1308315993214,16cyclictest1395218-21aten2_r5power_v08:35:171
1308315993214,16cyclictest1395218-21aten2_r5power_v08:35:171
1308313993226,4cyclictest1308158-21kworker/u8:0+flush-8:007:20:010
1308313993223,7cyclictest1528077-21ntpq10:45:260
1308313993221,9cyclictest1563960-21apt-get11:25:000
130831599316,14cyclictest0-21swapper/109:35:101
1308315993127,2cyclictest1309178-21irqrtprio07:10:191
130831599312,23cyclictest1469447-21apt-get09:50:131
1308315993121,8cyclictest1704890-21systemd-journal09:05:001
1308313993127,3cyclictest1345100-21kworker/u8:2+events_unbound08:14:180
1308313993126,3cyclictest1565044-21irqcore11:25:180
1308313993126,3cyclictest1473156-21needreboot09:50:240
1308318993026,2cyclictest1594400-21cpuspeed_turbos11:55:152
1308318993026,2cyclictest1469533-21aten2_r5power_p09:50:162
1308318993024,4cyclictest1508198-21kworker/u8:4+flush-8:010:55:052
130831599304,11cyclictest30-21ksoftirqd/111:10:161
130831599303,23cyclictest1622670-21ntpq12:20:261
130831599302,4cyclictest1554335-21apt-get11:15:151
1308315993022,6cyclictest1529022-21latency_hist10:50:011
1308315993019,9cyclictest1-21systemd12:00:011
130831599301,5cyclictest1499445-21apt-get10:20:131
1308315993013,15cyclictest1564130-21latency_hist11:25:011
130831599300,2cyclictest1599129-21apt-get12:00:131
130831599300,2cyclictest1599129-21apt-get12:00:121
1308318992920,6cyclictest1704890-21systemd-journal07:50:002
1308315992925,3cyclictest1415645-21irqrtprio08:55:191
1308315992923,4cyclictest1579063-21cron11:40:001
1308315992923,4cyclictest1533534-21unixbench_multi10:50:331
130831599292,22cyclictest1479389-21apt-get10:00:151
1308315992916,11cyclictest0-21swapper/110:00:011
1308318992823,3cyclictest1624070-21cpuspeed_turbos12:25:142
1308318992823,3cyclictest1454631-21aten2_r5power_c09:35:112
130831899281,12cyclictest1548219-21ntpq11:05:282
130831599284,20cyclictest0-21swapper/109:25:131
130831599283,21cyclictest0-21swapper/107:35:141
130831599282,23cyclictest1573251-21ntpq11:30:281
130831599282,21cyclictest0-21swapper/108:25:151
1308315992812,8cyclictest421rcuog/208:15:021
130831599281,11cyclictest1498339-21ntpq10:15:291
1308313992823,3cyclictest1519099-21cron10:40:000
1308313992818,8cyclictest1393903-21ntpq08:30:260
14937762270,5sleep3451irq_work/310:10:333
1308318992722,3cyclictest1614247-21fschecks_count12:15:172
1308315992721,4cyclictest1380275-21apt-get08:20:131
1308315992718,7cyclictest0-21swapper/110:55:151
130831599271,4cyclictest1400109-21apt-get08:40:191
130831599271,23cyclictest1617751-21taskset12:15:281
1308318992622,3cyclictest1514643-21cpuspeed_turbos10:35:172
1308318992622,3cyclictest1405377-21fschecks_time08:45:182
1308318992616,8cyclictest1704890-21systemd-journal08:26:272
130831899261,10cyclictest15513572tr11:10:232
1308315992622,3cyclictest1545145-21irqrtprio11:05:211
1308315992620,4cyclictest1391090-21kthreadcore08:30:211
1308315992616,8cyclictest0-21swapper/111:40:191
1308315992616,2cyclictest14053432fschecks_count08:45:181
1308315992615,9cyclictest0-21swapper/107:40:211
130831399268,16cyclictest1404828-21kworker/0:2+events09:15:300
1308313992620,5cyclictest1308158-21kworker/u8:0+flush-8:009:05:060
1308318992521,3cyclictest1419622-21sendmail09:00:012
1308318992515,7cyclictest1704890-21systemd-journal11:34:592
130831399253,20cyclictest1569210-21kworker/0:1+events11:45:330
1308313992521,2cyclictest0-21swapper/010:40:340
130831899246,16cyclictest1525087-21grep10:45:192
1308318992420,2cyclictest1429911-21aten2_r5power_v09:10:162
1308318992411,9cyclictest1464492-21apt-get09:45:142
1308318992320,2cyclictest1325598-21aten2_r5power_e07:25:142
130831399235,16cyclictest1569210-21kworker/0:1+events12:30:190
1308313992318,3cyclictest1634046-21fschecks_count12:35:160
1308318992218,3cyclictest0-21swapper/207:14:592
1308318992218,2cyclictest1579579-21cpuspeed_turbos11:40:152
1308318992218,2cyclictest1504516-21aten2_r5power_v10:25:142
1308318992217,4cyclictest1293424-21kworker/u8:1+flush-8:007:40:292
1308318992217,3cyclictest1584575-21fschecks_count11:45:162
1308318992213,7cyclictest1325049-21apt-get07:25:002
1308318992118,2cyclictest1484869-21fschecks_time10:05:182
1308318992118,2cyclictest1365413-21aten2_r5power_c08:05:152
1308318992117,3cyclictest1519452-21aten2_r5power_e10:40:162
1308318992117,2cyclictest0-21swapper/207:20:012
1308318992116,3cyclictest1499663-21cpuspeed_turbos10:20:152
1308318992115,4cyclictest1543473-21unixbench_multi11:00:312
1308318992115,4cyclictest1543473-21unixbench_multi11:00:302
1308318992113,6cyclictest1403695-21grep08:40:302
1308318992016,2cyclictest1593513-21unixbench_singl11:50:342
1308318992016,2cyclictest0-21swapper/208:15:012
1308318992015,3cyclictest1425156-21fschecks_time09:05:192
1308318992014,4cyclictest381ktimers/207:39:022
1308318992013,5cyclictest1704890-21systemd-journal11:19:592
1308318991916,2cyclictest1384491-21unixbench_multi08:20:322
1308318991915,2cyclictest0-21swapper/207:30:312
13034772194,9sleep20-21swapper/207:05:162
130831899183,9cyclictest1607844-21ntpq12:05:282
1308318991814,2cyclictest0-21swapper/212:04:342
1308318991814,2cyclictest0-21swapper/212:04:332
1308318991814,2cyclictest0-21swapper/209:30:322
1308318991813,3cyclictest0-21swapper/209:40:222
130831899181,13cyclictest1632612-21ntpq12:30:302
13035322182,8sleep30-21swapper/307:05:173
1308318991713,3cyclictest0-21swapper/208:05:002
1308318991713,2cyclictest0-21swapper/210:54:062
1308318991713,2cyclictest0-21swapper/210:10:242
1308318991713,2cyclictest0-21swapper/209:55:152
1308318991713,2cyclictest0-21swapper/209:20:012
1308318991713,2cyclictest0-21swapper/208:15:342
130831899170,15cyclictest1636610-21tr12:35:222
1308318991612,2cyclictest0-21swapper/208:30:252
14644662152,8sleep30-21swapper/309:45:143
130831899157,6cyclictest1619354-21if_enp4s0.212:20:192
15105102143,7sleep30-21swapper/310:30:243
16236082132,6sleep30-21swapper/312:25:023
16095102133,6sleep30-21swapper/312:10:213
15782742133,6sleep30-21swapper/311:35:343
15598932132,7sleep30-21swapper/311:20:213
14351312132,7sleep30-21swapper/309:15:203
14004822132,7sleep30-21swapper/308:40:243
13206102132,7sleep30-21swapper/307:20:183
16225012122,6sleep30-21swapper/312:20:253
16152092122,6sleep30-21swapper/312:15:223
16044612122,6sleep30-21swapper/312:05:203
15978632123,5sleep30-21swapper/311:55:253
15698572122,6sleep30-21swapper/311:30:193
15644582122,6sleep30-21swapper/311:25:153
15581772122,6sleep30-21swapper/311:15:303
15491162122,5sleep30-21swapper/311:10:023
15468652122,6sleep30-21swapper/311:05:243
15397362122,6sleep30-21swapper/311:00:183
15397362122,6sleep30-21swapper/311:00:173
15312522122,6sleep30-21swapper/310:50:223
15237432122,6sleep30-21swapper/310:40:363
15037272122,6sleep30-21swapper/310:20:333
14991502122,5sleep30-21swapper/310:20:003
14829412122,6sleep30-21swapper/310:00:273
14698212122,6sleep30-21swapper/309:50:193
14596022122,6sleep30-21swapper/309:40:153
14545062122,5sleep30-21swapper/309:35:023
14496732122,6sleep30-21swapper/309:30:173
14491172122,6sleep30-21swapper/309:26:273
14399962122,6sleep30-21swapper/309:20:173
14295592122,6sleep30-21swapper/309:10:023
14163722122,6sleep30-21swapper/308:55:213
13956302122,6sleep30-21swapper/308:35:223
13956302122,6sleep30-21swapper/308:35:223
13800342122,5sleep30-21swapper/308:20:013
13659332123,5sleep30-21swapper/308:05:203
13503412122,6sleep30-21swapper/307:50:153
13452702122,6sleep30-21swapper/307:45:013
13442102122,6sleep30-21swapper/307:40:293
13399702122,6sleep30-21swapper/307:38:283
13275442123,6sleep30-21swapper/307:25:243
13165092123,5sleep30-21swapper/307:15:233
13099132122,6sleep30-21swapper/307:10:233
16341332112,5sleep30-21swapper/312:35:183
16288022113,5sleep30-21swapper/312:30:153
15892262112,5sleep30-21swapper/311:50:023
15840332112,5sleep30-21swapper/311:45:013
15794292112,5sleep30-21swapper/311:40:163
15241342112,5sleep30-21swapper/310:45:003
15143712112,5sleep30-21swapper/310:35:023
15091082112,5sleep30-21swapper/310:30:003
14845212112,6sleep30-21swapper/310:05:083
14751752112,5sleep30-21swapper/309:55:203
14251512112,5sleep30-21swapper/309:05:203
14198762112,5sleep30-21swapper/309:00:153
14109762112,5sleep30-21swapper/308:50:233
14050222112,5sleep30-21swapper/308:45:063
13906782112,5sleep30-21swapper/308:30:213
13891072112,5sleep30-21swapper/308:25:313
13753012112,6sleep30-21swapper/308:15:163
13702962112,5sleep30-21swapper/308:10:023
13607962112,5sleep30-21swapper/308:00:193
13549912112,5sleep30-21swapper/307:55:013
13308902112,5sleep30-21swapper/307:30:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional