You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-27 - 22:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot8s.osadl.org (updated Sat Dec 27, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14294999910961,1089cyclictest1671576-21sleep10:15:003
1429499992840,280cyclictest1561435-21turbostat08:54:543
1429499992118,1cyclictest0-21swapper/311:40:163
1429499992118,1cyclictest0-21swapper/309:20:003
142949999197,8cyclictest1808133-21turbostat12:00:003
1429499991815,1cyclictest0-21swapper/307:45:233
301798170,5rtkit-daemon1763237-21apt-get11:25:141
1429499991715,1cyclictest0-21swapper/308:30:013
1429499991714,1cyclictest0-21swapper/312:30:223
1429499991714,1cyclictest0-21swapper/310:25:013
1429499991714,1cyclictest0-21swapper/308:00:003
142949999171,12cyclictest1587151-21turbostat09:09:593
169714921610,4sleep11697299-21vmstat10:30:241
16256322161,5sleep01625743-21timerandwakeup09:35:220
1429499991614,1cyclictest0-21swapper/309:45:163
1429499991614,1cyclictest0-21swapper/308:55:203
1429499991613,1cyclictest0-21swapper/312:15:003
1429499991613,1cyclictest0-21swapper/311:27:273
1429499991613,1cyclictest0-21swapper/311:10:153
1429499991613,1cyclictest0-21swapper/308:45:013
142949999161,11cyclictest1756826-21taskset11:20:143
1429499991610,4cyclictest1548477-21turbostat08:40:003
142949999155,8cyclictest1645735-21turbostat09:59:553
1429499991513,1cyclictest0-21swapper/312:26:283
1429499991513,1cyclictest0-21swapper/311:05:153
1429499991513,1cyclictest0-21swapper/308:15:233
1429499991513,1cyclictest0-21swapper/307:18:403
1429499991512,1cyclictest0-21swapper/311:02:013
1429499991512,1cyclictest0-21swapper/310:40:153
1429499991512,1cyclictest0-21swapper/310:30:283
1429499991512,1cyclictest0-21swapper/310:05:263
1429499991512,1cyclictest0-21swapper/309:15:013
1429499991512,1cyclictest0-21swapper/308:00:293
1429499991512,1cyclictest0-21swapper/307:33:303
1429499991511,1cyclictest0-21swapper/309:05:003
142949999151,10cyclictest1839637-21taskset12:20:253
142949999151,10cyclictest1795488-21taskset11:50:113
142949999144,7cyclictest1717831-21taskset10:50:053
142949999144,7cyclictest1626258-21taskset09:38:413
142949999143,8cyclictest1528679-21taskset08:20:253
1429499991412,1cyclictest0-21swapper/310:40:003
1429499991412,1cyclictest0-21swapper/309:53:523
1429499991412,1cyclictest0-21swapper/307:20:253
1429499991412,1cyclictest0-21swapper/307:15:003
1429499991411,1cyclictest0-21swapper/312:19:433
1429499991411,1cyclictest0-21swapper/311:30:163
142949999141,10cyclictest1795226-21sleep11:50:003
142949999141,10cyclictest1776061-21taskset11:35:003
142949999141,10cyclictest1686448-21taskset10:25:173
142949999141,10cyclictest1619673-21chrt09:32:043
17891692131,8sleep11789369-21hddtemp_smartct11:45:171
142949999135,6cyclictest1470832-21turbostat07:44:563
142949999131,9cyclictest1853704-21taskset12:35:033
142949999131,9cyclictest1814906-21taskset12:05:143
142949999131,9cyclictest1600865-21chrt09:20:103
142949999131,9cyclictest1555174-21taskset08:45:053
142949999131,9cyclictest1503680-21taskset08:05:143
142949999131,9cyclictest1490314-21taskset07:53:203
142949999131,8cyclictest16718042sleep310:15:123
1429499991311,1cyclictest0-21swapper/309:27:523
142949999131,10cyclictest1537283-21taskset08:30:183
142949999131,10cyclictest1470832-21turbostat07:40:003
142949999131,10cyclictest1470832-21turbostat07:40:003
1429499991310,1cyclictest0-21swapper/312:00:193
1429499991310,1cyclictest0-21swapper/311:19:593
1429499991310,1cyclictest0-21swapper/310:55:203
1429499991310,1cyclictest0-21swapper/309:40:173
301798120,6rtkit-daemon1652617-21df_inode10:00:131
142949999124,6cyclictest1658306-21taskset10:00:483
142949999121,9cyclictest1516259-21taskset08:14:593
142949999121,8cyclictest1711499-21taskset10:45:133
1429499991210,1cyclictest0-21swapper/307:25:223
301798110,6rtkit-daemon1770057-21hddtemp_smartct11:30:151
301798110,4rtkit-daemon636-21snmpd08:09:511
301798110,3rtkit-daemon636-21snmpd07:35:441
301798110,3rtkit-daemon636-21snmpd07:35:441
15738732110,2sleep20-21swapper/208:55:372
142949999119,1cyclictest0-21swapper/307:10:013
301798100,3rtkit-daemon2904-21cron10:53:001
15101032101,5sleep11510136-21apt-get08:10:131
14781542101,6sleep11478337-21irqcore07:45:171
14512202100,1sleep01451228-21latency_hist07:25:010
30179890,6rtkit-daemon667-21lldpd11:57:241
30179890,5rtkit-daemon3205-21sendmail-mta09:31:581
30179890,5rtkit-daemon317-21systemd-udevd08:19:331
30179890,5rtkit-daemon1753214-21kthreadcore11:15:211
30179890,5rtkit-daemon1536677-21irqcore08:30:171
30179890,4rtkit-daemon1701347-21ps10:35:181
30179890,4rtkit-daemon1593865-21cron09:15:001
30179890,2rtkit-daemon3205-21sendmail-mta07:27:131
30179890,1rtkit-daemon0-21swapper/110:22:011
30179890,1rtkit-daemon0-21swapper/108:41:331
1808394291,4sleep11808427-21apt-get12:00:121
1764838290,1sleep20-21swapper/211:25:192
1756791291,3sleep21756823-21apt-get11:20:142
1730712291,4sleep11730744-21apt-get11:00:151
1724252291,4sleep11724285-21apt-get10:55:131
1688513290,6sleep01689826-21memory10:25:190
1677046291,4sleep01677117-21ntp_states10:15:210
1639547291,4sleep01639696-21df_inode09:50:130
1632840290,1sleep01632877-21systemd09:45:000
1626824290,6sleep11626881-21grep09:40:171
1583603290,6sleep01585753-21tr09:05:170
1561866291,5sleep01562065-21hddtemp_smartct08:50:160
1444995291,4sleep21445028-21apt-get07:20:132
30179880,5rtkit-daemon667-21lldpd07:05:321
30179880,5rtkit-daemon3205-21sendmail-mta07:33:381
30179880,4rtkit-daemon667-21lldpd12:20:091
30179880,4rtkit-daemon667-21lldpd11:37:221
30179880,4rtkit-daemon667-21lldpd10:40:401
30179880,4rtkit-daemon667-21lldpd09:59:061
30179880,4rtkit-daemon667-21lldpd08:02:321
30179880,4rtkit-daemon636-21snmpd12:16:081
30179880,4rtkit-daemon636-21snmpd11:20:141
30179880,4rtkit-daemon448-21wpa_supplicant08:46:351
30179880,4rtkit-daemon317-21systemd-udevd12:11:341
30179880,4rtkit-daemon2904-21cron10:07:591
30179880,4rtkit-daemon1852459-21grep12:30:171
30179880,4rtkit-daemon1747466-21grep11:10:181
30179880,4rtkit-daemon1676425-21kthreadcore10:15:191
30179880,4rtkit-daemon1666663-21cut10:10:181
30179880,4rtkit-daemon1623805-21cut09:35:171
30179880,4rtkit-daemon1436259-21munin-node12:25:221
30179880,4rtkit-daemon1436259-21munin-node11:53:501
30179880,4rtkit-daemon1436259-21munin-node10:27:011
30179880,4rtkit-daemon1436259-21munin-node09:48:281
30179880,4rtkit-daemon1436259-21munin-node09:25:161
30179880,4rtkit-daemon1436259-21munin-node09:15:181
30179880,4rtkit-daemon1436259-21munin-node09:01:541
30179880,4rtkit-daemon1436259-21munin-node08:58:201
30179880,4rtkit-daemon1436259-21munin-node08:53:391
30179880,4rtkit-daemon1436259-21munin-node08:37:421
30179880,4rtkit-daemon1436259-21munin-node08:24:271
30179880,4rtkit-daemon1436259-21munin-node07:55:231
30179880,4rtkit-daemon1436259-21munin-node07:54:011
30179880,4rtkit-daemon1429870-21apt-get07:10:121
30179880,1rtkit-daemon0-21swapper/109:24:141
30179880,1rtkit-daemon0-21swapper/109:05:021
1856403280,5sleep11858540-21grep12:35:191
1815208280,5sleep11815750-21irqcore12:05:171
1770074281,4sleep21770693-21cut11:30:162
1690667281,3sleep21690690-21apt-get10:27:292
1665091281,4sleep01665134-21unin-run10:10:000
1593049281,4sleep01593174-21python309:10:220
1579751280,4sleep01579828-21ntp_states09:00:210
1568267280,5sleep01568367-21grep08:55:150
1547626281,4sleep01547751-21python308:35:210
1523370280,5sleep21523466-21ps08:20:172
1484221281,3sleep01484253-21apt-get07:50:120
1465378281,4sleep21466343-21cut07:35:162
1465378281,4sleep21466343-21cut07:35:162
1449829281,5sleep10-21swapper/107:20:211
30179870,3rtkit-daemon638-21ntpd10:45:151
30179870,3rtkit-daemon636-21snmpd09:51:331
30179870,3rtkit-daemon636-21snmpd07:40:481
30179870,3rtkit-daemon492-21gmain07:15:251
30179870,3rtkit-daemon1436259-21munin-node08:25:021
30179870,1rtkit-daemon0-21swapper/111:05:141
1839519270,4sleep21839636-21python312:20:252
1795641270,4sleep01795754-21perl11:50:130
1782704270,5sleep21782513-21/usr/sbin/munin11:40:142
1782548271,4sleep11782703-21diskstats11:40:131
1756249270,5sleep01756603-21apt-key11:20:000
1743752271,3sleep01743864-21perl11:10:140
1716683270,4sleep21716742-21ntp_states10:45:212
1697658271,3sleep01697784-21gpgv10:35:000
1608770270,4sleep01610626-21cut09:25:160
1548761270,4sleep01548917-21diskstats08:40:130
1499303270,4sleep01501382-21tr08:00:180
1490892271,3sleep00-21swapper/007:55:140
1464597271,3sleep01464796-21hddtemp_smartct07:35:150
1464597271,3sleep01464796-21hddtemp_smartct07:35:140
1451476271,3sleep01451509-21apt-get07:25:120
1859671260,1sleep00-21swapper/012:37:060
1853132260,1sleep00-21swapper/012:30:480
1834152261,2sleep00-21swapper/012:20:140
1828671260,2sleep00-21swapper/012:15:170
1821280261,3sleep01821426-21df12:10:130
1808430260,3sleep21808579-21df_inode12:00:132
1808007260,1sleep00-21swapper/011:58:350
1801913260,2sleep20-21swapper/211:55:132
1800732260,1sleep20-21swapper/211:50:192
1789371261,2sleep21789709-21irqcore11:45:182
1769211260,1sleep00-21swapper/011:27:290
1751035260,3sleep01752159-21cut11:15:200
1743562261,2sleep20-21swapper/211:10:122
1730433260,4sleep01730531-21date11:00:000
1698176261,2sleep01698209-21apt-get10:35:130
1645024260,1sleep2171rcu_preempt09:50:232
1607299261,2sleep20-21swapper/209:25:112
1601262260,3sleep01601510-21cut09:20:160
1599889260,3sleep01600019-21sed09:15:240
1595372260,4sleep21596428-21cut09:15:182
1538567262,2sleep01483705-21kworker/u16:1-kvfree_rcu_reclaim08:30:190
1535306260,1sleep00-21swapper/008:26:350
1504044260,3sleep21504557-21irqcore08:05:182
1496906260,3sleep21496961-21sendmail-msp08:00:002
1483887260,1sleep00-21swapper/007:49:000
1472539261,3sleep21474030-21grep07:40:182
1459504260,3sleep01461540-21cut07:30:170
1435496261,2sleep20-21swapper/207:10:242
1841296251,2sleep00-21swapper/012:25:150
1833761250,1sleep20-21swapper/212:18:402
1820938250,1sleep20-21swapper/212:09:232
1815008250,3sleep01815207-21/usr/sbin/munin12:05:160
1794851250,1sleep00-21swapper/011:45:320
1782512250,2sleep00-21swapper/011:40:110
1782030250,1sleep00-21swapper/011:37:230
1776075250,2sleep20-21swapper/211:35:122
1771874251,2sleep00-21swapper/011:30:190
1756188250,1sleep20-21swapper/211:19:152
1743190250,1sleep00-21swapper/011:08:300
1738026251,2sleep20-21swapper/211:05:152
1736697250,1sleep20-21swapper/211:02:482
1717275250,1sleep00-21swapper/010:46:020
1705315251,2sleep20-21swapper/210:40:152
1692678250,3sleep21692946-21kthreadcore10:30:172
1679061251,2sleep20-21swapper/210:20:212
1671345250,1sleep20-21swapper/210:12:222
1665000250,1sleep20-21swapper/210:08:512
1653402251,2sleep20-21swapper/210:00:162
1652628250,2sleep01652827-21hddtemp_smartct10:00:140
1647041250,3sleep01648187-21kthreadcore09:55:190
1638944250,1sleep20-21swapper/209:46:022
1632505250,1sleep20-21swapper/209:40:422
1626329250,1sleep20-21swapper/209:39:372
1615652251,2sleep00-21swapper/009:30:180
1613716250,2sleep20-21swapper/209:30:112
1606807250,1sleep20-21swapper/209:21:542
1588125250,3sleep21589112-21irqstats09:10:162
1586886250,1sleep20-21swapper/209:06:472
1542702251,2sleep20-21swapper/208:35:142
1535829250,2sleep20-21swapper/208:30:132
1530386250,3sleep21531522-21cut08:25:162
1524469250,2sleep01526122-21kthreadcore08:20:190
1522697250,1sleep00-21swapper/008:19:570
1509836250,1sleep00-21swapper/008:09:520
1497587250,3sleep21498173-21irqrtprio08:00:162
1490283250,1sleep20-21swapper/207:52:552
1476544251,2sleep00-21swapper/007:40:240
1438485250,1sleep00-21swapper/007:15:110
1432036251,2sleep00-21swapper/007:10:180
1423804250,2sleep20-21swapper/207:05:202
1859201240,2sleep21859334-21timerandwakeup12:35:242
1847672240,2sleep20-21swapper/212:30:142
1736725240,3sleep00-21swapper/011:03:090
1725705240,2sleep20-21swapper/210:55:182
1723971240,3sleep20-21swapper/210:54:422
1684112240,3sleep00-21swapper/010:20:580
1633095240,1sleep00-21swapper/009:45:120
1574685241,1sleep244-21ksoftirqd/209:00:152
1562647240,2sleep21563525-21kthreadcore08:50:172
1561212240,3sleep00-21swapper/008:47:260
1555637241,1sleep20-21swapper/208:45:172
1522389240,3sleep20-21swapper/208:16:032
1516125240,3sleep00-21swapper/008:13:170
1511022240,2sleep2421rcuc/208:10:182
1477743240,1sleep21477256-21apt-get07:45:022
1463865240,1sleep20-21swapper/207:31:282
1444511240,3sleep20-21swapper/207:17:212
1840770230,1sleep20-21swapper/212:25:132
1808673230,1sleep00-21swapper/012:00:150
1717838230,1sleep00-21swapper/010:50:120
1704440230,1sleep00-21swapper/010:40:010
1704115230,2sleep21429492-21cyclictest10:36:362
1674938230,1sleep20-21swapper/210:15:192
1670451230,1sleep00-21swapper/010:10:210
1650278230,1sleep20-21swapper/209:55:212
1554828230,1sleep20-21swapper/208:43:432
1454368230,1sleep20-21swapper/207:25:182
1422961230,1sleep00-21swapper/007:05:020
1821232220,1sleep20-21swapper/212:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional