You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-10 - 18:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Tue Mar 10, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13668479911860,1183cyclictest16495042sleep310:29:563
13668479911760,1173cyclictest15015582sleep308:50:003
13668479910901,1085cyclictest1832496-21sleep12:30:003
1366847999800,975cyclictest1741410-21sleep11:30:003
140035621000,1sleep20-21swapper/207:30:182
15497422200,1sleep0471rcuog/209:22:190
136684799188,8cyclictest17948532sleep312:05:033
136684799186,8cyclictest13665612sleep307:10:013
136684799177,7cyclictest1558013-21turbostat09:30:013
136684799176,8cyclictest1408688-21taskset07:39:583
136684799171,11cyclictest1634710-21taskset10:20:103
1366847991613,1cyclictest0-21swapper/311:03:053
1366847991613,1cyclictest0-21swapper/309:35:193
136684799161,12cyclictest1718389-21taskset11:15:013
136684799161,12cyclictest1688132-21taskset10:55:013
136684799161,12cyclictest1688132-21taskset10:55:003
136684799161,11cyclictest1726516-21taskset11:20:133
136684799161,11cyclictest1462079-21taskset08:20:123
173198150,4rtkit-daemon1542727-21ssh09:19:250
136684799158,4cyclictest18403512chrt12:35:123
136684799155,8cyclictest1508122-21taskset08:55:023
136684799155,7cyclictest1610631-21taskset10:02:183
136684799155,7cyclictest1415363-21turbostat07:49:553
136684799154,7cyclictest14287872sleep307:55:123
136684799153,9cyclictest1373689-21taskset07:15:013
136684799151,9cyclictest1741698-21chrt11:30:123
136684799151,9cyclictest15941932sleep309:50:223
136684799151,9cyclictest14751952sleep308:30:113
1366847991513,1cyclictest0-21swapper/310:48:403
1366847991513,0cyclictest0-21swapper/311:43:363
1366847991513,0cyclictest0-21swapper/309:04:273
1366847991513,0cyclictest0-21swapper/308:42:543
1366847991513,0cyclictest0-21swapper/307:53:493
1366847991513,0cyclictest0-21swapper/307:33:543
1366847991512,1cyclictest0-21swapper/310:12:033
136684799151,11cyclictest1670588-21taskset10:40:213
136684799151,11cyclictest1573452-21taskset09:40:033
136684799151,11cyclictest1527693-21taskset09:10:003
136684799151,10cyclictest1660740-21taskset10:35:173
136684799150,12cyclictest1442196-21taskset08:05:023
173198140,5rtkit-daemon1394816-21find07:25:250
136684799147,4cyclictest1588380-21turbostat09:50:003
136684799144,7cyclictest1494976-21taskset08:45:093
136684799143,7cyclictest14491662sleep308:10:153
1366847991412,1cyclictest0-21swapper/308:39:363
1366847991412,0cyclictest0-21swapper/311:47:373
1366847991412,0cyclictest0-21swapper/311:06:513
1366847991412,0cyclictest0-21swapper/311:06:513
1366847991412,0cyclictest0-21swapper/310:09:223
1366847991411,1cyclictest0-21swapper/312:30:183
1366847991411,1cyclictest0-21swapper/312:01:013
1366847991411,1cyclictest0-21swapper/308:25:253
136684799141,10cyclictest1823975-21chrt12:21:373
136684799141,10cyclictest1777995-21taskset11:50:263
136684799141,10cyclictest1603488-21turbostat10:00:013
136684799141,10cyclictest1561083-21taskset09:30:163
136684799141,10cyclictest1550318-21chrt09:24:323
136684799141,10cyclictest1441709-21turbostat08:05:003
136684799140,11cyclictest1627004-21chrt10:15:003
136684799140,11cyclictest1534126-21taskset09:10:453
17471192130,2sleep00-21swapper/011:30:220
173198130,9rtkit-daemon1527648-21diskmemload12:18:290
14883912131,8sleep11488424-21apt-get08:40:101
13812872131,1sleep30-21swapper/307:15:213
136684799135,5cyclictest17250562sleep311:15:583
136684799134,7cyclictest1816169-21taskset12:15:483
136684799131,9cyclictest1802447-21taskset12:10:073
136684799131,8cyclictest1749231-21chrt11:35:113
136684799131,10cyclictest1694339-21taskset10:55:293
136684799131,10cyclictest1694339-21taskset10:55:293
1366847991310,1cyclictest0-21swapper/309:19:353
136684799130,10cyclictest1655974-21taskset10:30:403
136684799130,10cyclictest1461558-21chrt08:17:203
136684799130,10cyclictest1408956-21taskset07:40:013
136684799130,10cyclictest1388089-21taskset07:20:223
18024632120,9sleep21527648-21diskmemload12:10:112
18012902121,3sleep01527648-21diskmemload12:06:390
173198120,9rtkit-daemon500-21gmain09:33:320
16650232122,5sleep01665026-21apt-get10:40:120
16543332120,2sleep01652940-21kthreadcore10:30:160
16498082123,5sleep11649843-21apt-get10:30:101
15352562120,4sleep11535301-21munin-run09:15:011
136684799123,7cyclictest1779434-21taskset11:55:043
136684799121,8cyclictest1389414-21chrt07:25:153
173198110,6rtkit-daemon1527648-21diskmemload10:09:072
173198110,6rtkit-daemon1414484-21ntp_states07:40:210
173198110,4rtkit-daemon647-21lldpd09:45:400
173198110,3rtkit-daemon1733108-21ssh11:22:320
15886902111,7sleep21588846-21df_inode09:50:132
15199842110,8sleep21520074-21ntpq09:00:192
13958682111,7sleep11395935-21tune2fs07:30:141
13813392111,7sleep01381387-21ntp_states07:15:220
18006112101,2sleep11800723-21ssh12:05:241
17643322101,4sleep01764367-21apt-get11:45:120
17416712102,4sleep21741693-21apt-get11:30:122
173198100,6rtkit-daemon1832924-21df_inode12:30:130
173198100,6rtkit-daemon1558221-21latency_hist09:30:010
173198100,6rtkit-daemon1402493-21diskstats07:35:150
173198100,5rtkit-daemon1800972-21users12:05:252
173198100,5rtkit-daemon1673184-21hddtemp_smartct10:45:160
173198100,4rtkit-daemon643-21snmpd08:48:052
173198100,3rtkit-daemon643-21snmpd10:27:070
173198100,3rtkit-daemon643-21snmpd08:15:280
16642842100,7sleep11664287-21ssh10:38:291
16264922100,7sleep11626603-21base6410:15:001
15582782102,4sleep11558310-21apt-get09:30:121
14806352101,5sleep11480677-21ntpq08:30:211
14686082101,5sleep21468641-21apt-get08:25:122
13945102101,5sleep11394561-21ntpq07:25:221
1846417290,7sleep21846419-21ssh12:35:442
1842636291,5sleep01844388-21kthreadcore12:35:170
1825195291,4sleep01825342-21df12:25:120
1818463294,2sleep1331ktimers/112:20:151
1817279290,3sleep11817283-21ssh12:19:561
1794343290,6sleep11794360-21latency_hist12:05:011
1784928291,5sleep11784980-21ntpq11:55:191
1740253290,6sleep11740257-21ssh11:25:451
17319890,6rtkit-daemon649-21ntpd07:06:450
17319890,5rtkit-daemon643-21snmpd11:16:322
17319890,5rtkit-daemon1763874-21ssh11:44:181
17319890,5rtkit-daemon1596223-21cat09:55:100
17319890,4rtkit-daemon1693697-21/usr/sbin/munin10:55:210
17319890,4rtkit-daemon1693697-21/usr/sbin/munin10:55:200
17319890,4rtkit-daemon1657457-21apt-get10:35:120
17319890,4rtkit-daemon1447747-21ntpq08:05:230
17319890,4rtkit-daemon1415634-21apt-get07:45:110
1688273291,4sleep21688308-21apt-get10:55:132
1688273291,4sleep21688308-21apt-get10:55:132
1672851291,4sleep11672886-21apt-get10:45:131
1662871290,1sleep20-21swapper/210:35:212
1572524290,6sleep21527648-21diskmemload09:37:342
1513623290,6sleep01513724-21/usr/sbin/munin08:55:230
1481785291,4sleep01481818-21apt-get08:35:130
1435360290,2sleep10-21swapper/108:00:121
1434239291,4sleep11434287-21ps07:55:231
1401097292,4sleep01401141-21ntpq07:30:210
1817949280,5sleep01818461-21cut12:20:140
1805454280,5sleep11807624-21sshd12:10:181
1754962281,4sleep01755204-21unixbench_multi11:35:270
17319880,5rtkit-daemon647-21lldpd09:13:392
17319880,5rtkit-daemon435-21avahi-daemon07:50:140
17319880,5rtkit-daemon1730-21rtkit-daemon11:11:172
17319880,4rtkit-daemon453-21wpa_supplicant09:50:510
17319880,4rtkit-daemon1756142-21ssh11:38:411
17319880,4rtkit-daemon1748789-21ssh11:34:361
17319880,4rtkit-daemon1685986-21ntp_states10:50:200
17319880,4rtkit-daemon1685986-21ntp_states10:50:200
17319880,4rtkit-daemon1579052-21ntpq09:40:220
17319880,4rtkit-daemon1373771-21munin-node10:24:410
17319880,3rtkit-daemon1487248-21ntpq08:35:222
17319880,1rtkit-daemon0-21swapper/208:57:332
17319880,1rtkit-daemon0-21swapper/009:38:170
17319880,1rtkit-daemon0-21swapper/008:01:310
1726476280,4sleep21726511-21apt-get11:20:142
1725174280,1sleep00-21swapper/011:16:230
1694605280,2sleep11694609-21ssh10:56:281
1694605280,2sleep11694609-21ssh10:56:281
1687715281,4sleep21688127-21apt-config10:55:012
1687715281,4sleep21688127-21apt-config10:55:002
1686548280,2sleep11686550-21ssh10:50:351
1686548280,2sleep11686550-21ssh10:50:351
1678312281,4sleep21678365-21ntpq10:45:232
1634671281,4sleep2643-21snmpd10:20:102
1632923281,4sleep01633114-21/usr/sbin/munin10:15:230
1611670281,4sleep01611826-21df_inode10:05:120
1609347280,4sleep01609489-21ntpq10:00:200
1596418281,4sleep21596542-21hddtemp_smartct09:55:132
1588317280,5sleep11588321-21ssh09:49:511
1565883281,4sleep11565918-21apt-get09:35:121
1541686280,6sleep11527648-21diskmemload09:15:371
1534316281,3sleep01534320-21ssh09:11:350
1526917283,2sleep21527027-21grep09:05:232
1496361281,4sleep01498037-21cut08:45:190
1493757281,4sleep21493796-21ntpq08:40:202
1480584280,5sleep01480633-21ntpq08:30:200
1474049280,4sleep01474097-21ntp_states08:25:220
1381191281,4sleep21381285-21ntpq07:15:202
1362720281,4sleep11364881-21cut07:05:191
1846900270,1sleep10-21swapper/112:37:341
1810000270,3sleep21810034-21ssh12:15:122
1772246270,4sleep21772670-21cut11:50:142
1771962270,4sleep01772118-21diskstats11:50:130
1769786270,3sleep11769833-21ssh11:45:211
17319870,4rtkit-daemon643-21snmpd07:11:410
17319870,4rtkit-daemon500-21gmain12:13:480
17319870,4rtkit-daemon500-21gmain11:25:390
17319870,4rtkit-daemon1373771-21munin-node11:02:180
17319870,3rtkit-daemon1764533-21diskstats11:45:142
17319870,3rtkit-daemon1627967-21ps10:15:122
17319870,3rtkit-daemon1431985-21tr07:55:170
17319870,3rtkit-daemon1373771-21munin-node08:22:292
17319870,3rtkit-daemon1373771-21munin-node08:10:100
17319870,3rtkit-daemon1373771-21munin-node07:21:200
17319870,1rtkit-daemon0-21swapper/208:31:022
1709655270,5sleep21709659-21ssh11:06:072
1709655270,5sleep21709659-21ssh11:06:072
1702968270,4sleep11702972-21ssh11:04:211
1671460270,5sleep11671464-21ssh10:41:531
1649516271,3sleep21649530-21apt10:30:002
1641892270,4sleep11527648-21diskmemload10:24:421
1619198271,2sleep20-21swapper/210:10:122
1588653271,3sleep11588685-21apt-get09:50:111
1579280270,4sleep11579522-21tail09:40:261
1557983270,4sleep21557993-21cron09:30:012
1557079270,1sleep11557083-21ssh09:26:311
1501888271,4sleep00-21swapper/008:50:160
1483160270,4sleep11484413-21cut08:35:181
1454277270,1sleep10-21swapper/108:10:211
1436735271,3sleep21438021-21tr08:00:172
1427504270,4sleep21427560-21ntpq07:50:192
1416977271,3sleep11418364-21kthreadcore07:45:161
1373519270,4sleep21373688-21wc07:15:012
1366206270,4sleep21360289-21/usr/sbin/munin07:05:282
1838972260,1sleep21838976-21ssh12:31:072
1836108261,2sleep11837971-21ssh12:30:181
1832252261,3sleep21832256-21ssh12:29:152
1827807260,4sleep11829871-21kthreadcore12:25:171
1819392261,2sleep20-21swapper/212:20:172
1793424260,1sleep00-21swapper/012:01:350
1786164260,1sleep20-21swapper/211:57:492
1778099260,1sleep11778103-21ssh11:50:571
1763177260,1sleep21763181-21ssh11:41:422
17319860,3rtkit-daemon500-21gmain08:50:032
17319860,3rtkit-daemon500-21gmain08:19:482
17319860,2rtkit-daemon1794044-21ssh12:03:562
17319860,2rtkit-daemon1610599-21ssh10:02:122
17319860,2rtkit-daemon0-21swapper/011:55:170
1725048260,1sleep10-21swapper/111:15:561
1717898260,1sleep00-21swapper/011:13:330
1717607260,3sleep11717611-21ssh11:12:301
1704829263,1sleep01706376-21grep11:05:170
1704829263,1sleep01706376-21grep11:05:170
1701324261,2sleep20-21swapper/211:00:212
1671757260,1sleep20-21swapper/210:42:592
1649779260,1sleep20-21swapper/210:30:032
1645055260,4sleep11647147-21kthreadcore10:25:181
1633252260,1sleep10-21swapper/110:15:511
1625752260,1sleep00-21swapper/010:12:150
1611827260,1sleep10-21swapper/110:05:141
1610737260,4sleep10-21swapper/110:02:501
1603157260,1sleep10-21swapper/109:58:531
1576085260,4sleep21578136-21kthreadcore09:40:192
1564506260,1sleep20-21swapper/209:30:572
1549783260,4sleep11549787-21ssh09:22:291
1508959261,3sleep11509545-21kthreadcore08:55:171
1501264260,1sleep10-21swapper/108:49:201
1467521261,3sleep1436-21dbus-daemon08:20:231
1447626261,2sleep20-21swapper/208:05:222
1421697260,1sleep20-21swapper/207:47:192
1408691260,3sleep11408945-21cat07:40:011
1388701260,1sleep20-21swapper/207:23:152
1757143251,2sleep00-21swapper/011:40:140
1740402250,3sleep21740408-21ssh11:26:192
1731221250,2sleep10-21swapper/111:20:211
1706377250,2sleep10-21swapper/111:05:181
1706377250,2sleep10-21swapper/111:05:181
1583474251,2sleep20-21swapper/209:45:152
1543491250,3sleep21543603-21cat09:20:142
1527372250,1sleep00-21swapper/009:06:340
1521595250,2sleep10-21swapper/109:05:141
1520794250,1sleep00-21swapper/009:02:020
1507188250,2sleep10-21swapper/108:50:251
1467481250,3sleep01467520-21gcc08:20:220
1461549250,1sleep10-21swapper/108:17:151
1442210250,2sleep10-21swapper/108:05:131
1428751251,1sleep20-21swapper/207:55:112
1409166251,2sleep20-21swapper/207:40:142
1407500250,2sleep21407672-21strings07:35:212
1373170250,3sleep10-21swapper/107:10:321
1749191241,1sleep20-21swapper/211:35:112
1541795240,2sleep20-21swapper/209:16:022
1454986240,1sleep20-21swapper/208:12:342
1428441240,1sleep10-21swapper/107:54:191
1411131240,1sleep10-21swapper/107:40:171
1389290240,2sleep20-21swapper/207:25:152
1387960240,2sleep10-21swapper/107:20:211
1514717230,1sleep10-21swapper/109:00:101
1488225230,1sleep00-21swapper/008:40:010
1468860230,1sleep10-21swapper/108:25:151
1375786230,1sleep10-21swapper/107:15:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional