You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-19 - 05:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8s.osadl.org (updated Fri Dec 19, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16210519913020,1299cyclictest17783572sleep321:10:023
16210519912711,1265cyclictest17460272sleep320:45:023
1621051993391,334cyclictest1932732-21turbostat23:14:543
1621051993220,319cyclictest1996927-21turbostat00:04:563
1621051993081,303cyclictest1900696-21turbostat22:49:553
1621051993081,303cyclictest1900696-21turbostat22:49:553
1621051992390,235cyclictest1964852-21turbostat23:39:553
1621051991815,1cyclictest0-21swapper/322:30:253
1621051991815,1cyclictest0-21swapper/321:20:153
17265202172,4sleep01726553-21apt-get20:30:130
1621051991714,1cyclictest0-21swapper/322:55:003
1621051991714,1cyclictest0-21swapper/322:40:153
162105199171,12cyclictest2029132-21turbostat00:25:003
17787712161,12sleep11779250-21cut21:10:171
162105199169,3cyclictest1932734-21sleep23:10:003
162105199162,10cyclictest1681634-21chrt19:55:133
1621051991613,1cyclictest0-21swapper/320:15:253
162105199161,12cyclictest1835982-21turbostat21:55:003
162105199161,11cyclictest1765576-21taskset21:00:113
301798150,10rtkit-daemon1904279-21cut22:45:192
301798150,10rtkit-daemon1904279-21cut22:45:182
1621051991513,1cyclictest0-21swapper/321:05:193
1621051991513,1cyclictest0-21swapper/319:54:163
1621051991512,1cyclictest0-21swapper/322:37:013
1621051991512,1cyclictest0-21swapper/319:45:213
1621051991512,1cyclictest0-21swapper/319:20:153
162105199151,11cyclictest1952311-21taskset23:25:123
162105199151,11cyclictest1944018-21taskset23:15:193
162105199151,11cyclictest1836415-21taskset21:55:123
17868492141,3sleep11788954-21kthreadcore21:15:171
1621051991412,1cyclictest0-21swapper/322:26:583
1621051991412,1cyclictest0-21swapper/300:12:233
162105199141,11cyclictest1971505-21taskset23:40:033
1621051991411,1cyclictest0-21swapper/320:55:233
1621051991411,1cyclictest0-21swapper/320:00:383
162105199141,10cyclictest2034653-21taskset00:25:183
162105199141,10cyclictest1853529-21taskset22:05:193
162105199141,10cyclictest1809951-21chrt21:31:133
162105199141,10cyclictest1790596-21taskset21:15:273
162105199141,10cyclictest1739178-21taskset20:40:013
162105199141,10cyclictest1706695-21chrt20:10:523
162105199141,10cyclictest1700379-21chrt20:06:313
20382102131,3sleep20-21swapper/200:30:182
19653902131,3sleep10-21swapper/123:35:171
162105199134,6cyclictest1752455-21taskset20:50:103
162105199133,8cyclictest1862296-21taskset22:15:133
162105199131,9cyclictest2041884-21taskset00:30:423
162105199131,9cyclictest2009393-21taskset00:05:393
162105199131,9cyclictest1926033-21chrt23:01:403
162105199131,9cyclictest1861378-21chrt22:11:563
162105199131,9cyclictest1829293-21taskset21:46:403
162105199131,9cyclictest1810538-21taskset21:35:143
162105199131,9cyclictest1803466-21taskset21:25:403
1621051991312,0cyclictest0-21swapper/321:44:343
1621051991312,0cyclictest0-21swapper/319:31:543
1621051991311,1cyclictest0-21swapper/322:55:143
1621051991311,1cyclictest0-21swapper/300:36:513
1621051991310,1cyclictest0-21swapper/322:01:493
1621051991310,1cyclictest0-21swapper/320:42:473
1621051991310,1cyclictest0-21swapper/320:25:163
162105199130,10cyclictest2021760-21chrt00:15:203
162105199130,10cyclictest1996800-21taskset23:58:463
301798120,3rtkit-daemon3200908-21packagekitd22:54:012
19070862121,8sleep01907089-21cron22:50:000
19070862121,8sleep01907089-21cron22:49:590
162105199129,1cyclictest0-21swapper/323:50:183
162105199129,1cyclictest0-21swapper/319:40:153
162105199121,9cyclictest1964550-21chrt23:31:293
162105199121,9cyclictest1661673-21taskset19:35:303
162105199121,9cyclictest1642950-21chrt19:25:083
162105199121,8cyclictest1726511-21chrt20:30:073
1621051991211,0cyclictest0-21swapper/320:20:193
1621051991211,0cyclictest0-21swapper/320:20:183
1621051991210,1cyclictest0-21swapper/319:15:023
1621051991210,1cyclictest0-21swapper/319:10:073
162105199120,9cyclictest1977922-21taskset23:45:073
162105199120,9cyclictest1874773-21taskset22:22:093
162105199120,10cyclictest1951680-21chrt23:20:393
301798110,7rtkit-daemon1725560-21mailstats20:25:232
301798110,4rtkit-daemon636-21snmpd19:53:012
301798110,4rtkit-daemon1627886-21munin-node23:33:152
301798100,6rtkit-daemon448-21wpa_supplicant21:25:012
301798100,5rtkit-daemon1957593-21ntp_states23:25:202
301798100,3rtkit-daemon636-21snmpd22:31:462
301798100,1rtkit-daemon0-21swapper/200:11:222
19715192102,4sleep01971552-21apt-get23:40:120
19280112101,6sleep11929549-21grep23:05:201
17721492101,6sleep11772309-21gltestperf21:05:161
30179890,5rtkit-daemon638-21ntpd21:10:402
30179890,5rtkit-daemon638-21ntpd00:24:162
30179890,5rtkit-daemon3205-21sendmail-mta00:29:292
30179890,5rtkit-daemon317-21systemd-udevd19:41:332
30179890,5rtkit-daemon1970207-21memory23:35:212
30179890,5rtkit-daemon1802967-21ntp_states21:25:222
30179890,4rtkit-daemon448-21wpa_supplicant22:09:132
30179890,4rtkit-daemon1928112-21tr23:05:192
30179890,3rtkit-daemon636-21snmpd23:19:142
30179890,3rtkit-daemon492-21gmain20:31:352
30179890,3rtkit-daemon492-21gmain00:03:472
30179890,2rtkit-daemon1699723-21strings20:05:202
30179890,2rtkit-daemon0-21swapper/223:50:062
30179890,1rtkit-daemon3016-21rtkit-daemon22:15:132
30179890,1rtkit-daemon0-21swapper/221:07:472
30179890,1rtkit-daemon0-21swapper/220:23:592
30179890,1rtkit-daemon0-21swapper/220:23:582
30179890,1rtkit-daemon0-21swapper/219:30:082
30179890,1rtkit-daemon0-21swapper/219:29:562
2022657290,6sleep12022799-21latency_hist00:20:001
2011009291,5sleep12012134-21kthreadcore00:10:191
1984507290,6sleep01984577-21fschecks_time23:50:140
1739429291,5sleep01739585-21diskstats20:40:150
1649135291,5sleep11649174-21true19:30:001
30179880,4rtkit-daemon667-21lldpd23:13:042
30179880,4rtkit-daemon667-21lldpd20:55:332
30179880,4rtkit-daemon667-21lldpd19:35:322
30179880,4rtkit-daemon638-21ntpd19:20:092
30179880,4rtkit-daemon638-21ntpd19:06:522
30179880,4rtkit-daemon636-21snmpd21:58:072
30179880,4rtkit-daemon448-21wpa_supplicant22:02:532
30179880,4rtkit-daemon2016937-21cut00:15:162
30179880,4rtkit-daemon1817150-21df_inode21:40:152
30179880,4rtkit-daemon1627886-21munin-node22:42:052
30179880,4rtkit-daemon1627886-21munin-node21:45:032
30179880,4rtkit-daemon1627886-21munin-node21:35:372
30179880,4rtkit-daemon1627886-21munin-node20:14:472
30179880,4rtkit-daemon1627886-21munin-node20:00:312
30179880,4rtkit-daemon1627886-21munin-node19:46:222
30179880,4rtkit-daemon0-21swapper/222:20:242
30179880,4rtkit-daemon0-21swapper/200:08:142
30179880,3rtkit-daemon1919751-21sshd22:58:092
30179880,2rtkit-daemon0-21swapper/220:17:362
30179880,1rtkit-daemon0-21swapper/223:55:282
30179880,1rtkit-daemon0-21swapper/222:35:412
30179880,1rtkit-daemon0-21swapper/222:28:162
30179880,1rtkit-daemon0-21swapper/220:40:232
30179880,1rtkit-daemon0-21swapper/219:55:102
30179880,1rtkit-daemon0-21swapper/219:12:022
1974098280,6sleep21976276-21tr23:40:192
1922913280,5sleep11925095-21grep23:00:191
1913738281,4sleep01913771-21apt-get22:55:130
1900928281,3sleep11900961-21apt-get22:45:131
1900928281,3sleep11900961-21apt-get22:45:121
1855500281,4sleep01855652-21df_inode22:10:130
1847870281,4sleep01847945-21grep22:00:200
1805873280,5sleep01807907-21cut21:30:180
1783705281,4sleep01783786-21/usr/sbin/munin21:10:240
1771695280,5sleep21771739-21munin-run21:05:012
1746042281,3sleep01746075-21apt-get20:45:120
1702046281,5sleep01703194-21kthreadcore20:10:180
1672772281,4sleep11673840-21memory19:45:191
1630472280,5sleep21630609-21sed19:15:152
1615420281,4sleep30-21swapper/319:05:173
30179870,4rtkit-daemon636-21snmpd23:03:422
30179870,4rtkit-daemon492-21gmain23:46:072
30179870,4rtkit-daemon492-21gmain22:11:112
30179870,4rtkit-daemon492-21gmain21:30:312
30179870,4rtkit-daemon492-21gmain20:51:552
30179870,3rtkit-daemon636-21snmpd23:20:182
30179870,3rtkit-daemon3200908-21packagekitd21:50:112
30179870,3rtkit-daemon1747594-21kthreadcore20:45:172
30179870,3rtkit-daemon1627886-21munin-node21:15:472
30179870,3rtkit-daemon1627886-21munin-node20:35:292
30179870,3rtkit-daemon1627886-21munin-node00:35:042
1964826270,4sleep11964869-21munin-run23:35:011
1939880271,4sleep01940703-21sed23:15:170
1934776271,4sleep01936859-21tr23:10:200
1933172271,3sleep11933374-21sort23:10:171
1920209271,3sleep01920364-21diskstats23:00:130
1908796270,4sleep11909933-21tr22:50:171
1894731271,4sleep01894841-21perl22:40:150
1874994271,3sleep00-21swapper/022:25:000
1874927271,4sleep1297-21systemd-journal22:24:091
1836234270,3sleep11836256-21apt-get21:55:111
1822202270,4sleep11822273-21ntp_states21:40:221
1804368271,4sleep11804477-21idleruntime21:30:151
1792444271,3sleep11793631-21grep21:20:181
1752762270,4sleep11752858-21hddtemp_smartct20:50:171
1716167270,5sleep11718328-21cut20:20:211
1716167270,5sleep11718328-21cut20:20:211
1712619270,3sleep11712743-21python320:15:231
1700461270,1sleep10-21swapper/120:07:341
1676168270,4sleep01676997-21kthreadcore19:50:190
2037535260,3sleep12038209-21grep00:30:181
2036081261,2sleep00-21swapper/000:30:130
2018396260,4sleep02020477-21kthreadcore00:15:180
1990736260,4sleep10-21swapper/123:55:121
1946197261,3sleep00-21swapper/023:20:170
1868297261,2sleep10-21swapper/122:20:001
1866159260,4sleep01867259-21memory22:15:190
1861264261,2sleep10-21swapper/122:10:261
1854853260,1sleep00-21swapper/022:05:290
1842380260,3sleep01842409-21munin-run22:00:000
1835804260,1sleep00-21swapper/021:52:550
1829338260,1sleep10-21swapper/121:47:151
1799105261,3sleep00-21swapper/021:25:180
1791237260,3sleep01791269-21apt-get21:20:130
1771992260,3sleep01772148-21diskstats21:05:140
1759117260,2sleep00-21swapper/020:55:130
1734413260,4sleep11736066-21cut20:35:181
1720104261,2sleep00-21swapper/020:25:110
1708732260,4sleep01710244-21kthreadcore20:15:180
1701088261,2sleep10-21swapper/120:10:151
1686655260,3sleep11686796-21needreboot19:55:201
1670656260,3sleep01672771-21grep19:45:180
1667668260,1sleep10-21swapper/119:40:221
1656217260,3sleep01656569-21sed19:35:150
1654664260,3sleep01654717-21ntp_states19:30:190
1641801260,3sleep11641857-21ntp_states19:20:181
1636537261,2sleep01636572-21apt-get19:20:100
1620087260,3sleep11620211-21python319:05:241
2048274250,1sleep10-21swapper/100:35:431
2035707250,1sleep10-21swapper/100:28:341
2029077250,1sleep00-21swapper/000:24:310
2028807250,1sleep10-21swapper/100:21:031
2009994250,2sleep00-21swapper/000:10:140
2009617250,1sleep00-21swapper/000:08:290
2002455250,3sleep11997190-21/usr/sbin/munin00:00:251
1998821251,2sleep00-21swapper/000:00:200
1990289250,1sleep10-21swapper/123:52:361
1983761250,3sleep00-21swapper/023:46:100
1967252250,2sleep00-21swapper/023:35:200
1964135250,2sleep01964300-21/usr/sbin/munin23:30:230
1940704251,2sleep10-21swapper/123:15:181
1900532250,1sleep10-21swapper/122:43:121
1889573250,3sleep11891556-21cut22:35:191
1887731250,1sleep00-21swapper/022:33:500
1881682251,2sleep11881741-21grep22:30:141
1875287251,2sleep10-21swapper/122:25:131
1844115251,2sleep10-21swapper/122:00:171
1765792250,3sleep10-21swapper/121:00:151
1765083250,1sleep10-21swapper/120:57:431
1758254250,1sleep00-21swapper/020:50:440
1746951251,2sleep11608234-21kworker/1:1-events20:45:171
1742581250,3sleep11744470-21latency20:40:201
1738462251,2sleep01738700-21unixbench_singl20:35:260
1726064250,1sleep10-21swapper/120:27:301
1714980250,3sleep01716165-21kthreadcore20:20:200
1714980250,3sleep01716165-21kthreadcore20:20:200
1699753250,3sleep00-21swapper/020:05:210
1694033250,1sleep10-21swapper/120:02:411
1686939250,2sleep00-21swapper/019:55:230
1681022250,1sleep10-21swapper/119:50:561
1662024250,1sleep00-21swapper/019:40:010
1661706250,4sleep1667-21lldpd19:35:561
1651012250,3sleep11653077-21kthreadcore19:30:161
1636218250,1sleep00-21swapper/019:19:250
1621604251,2sleep00-21swapper/019:10:160
1616312251,2sleep00-21swapper/019:05:190
2044452240,2sleep00-21swapper/000:35:170
2035526240,1sleep00-21swapper/000:26:160
2005471240,2sleep12007553-21cut00:05:211
1996277240,1sleep00-21swapper/023:55:230
1972975240,2sleep10-21swapper/123:40:171
1958374240,2sleep00-21swapper/023:29:150
1932510240,3sleep00-21swapper/023:07:270
1914720240,1sleep10-21swapper/122:55:181
1907343240,1sleep00-21swapper/022:50:120
1875251240,1sleep00-21swapper/022:25:110
1855135240,2sleep10-21swapper/122:09:071
1829358240,3sleep00-21swapper/021:47:290
1816390240,3sleep00-21swapper/021:36:160
1785784240,2sleep00-21swapper/021:15:170
1645200240,2sleep00-21swapper/019:25:180
1621852240,2sleep11622785-21kthreadcore19:10:171
1982181230,1sleep10-21swapper/123:45:181
1956068230,1sleep10-21swapper/123:25:181
1946335230,1sleep11947237-21cut23:20:181
1893366230,1sleep00-21swapper/022:35:220
1830017230,1sleep10-21swapper/121:50:151
1823101230,1sleep00-21swapper/021:44:500
1810501230,1sleep10-21swapper/121:35:131
1797840230,1sleep10-21swapper/121:25:151
1766998230,1sleep00-21swapper/021:00:180
1726556230,1sleep10-21swapper/120:30:141
1688034230,1sleep00-21swapper/020:00:120
1627874230,1sleep10-21swapper/119:15:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional