You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-11 - 01:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Mon Aug 10, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1612665995548,4cyclictest1640503-21idleruntime-cro08:30:001
1612665995548,4cyclictest1640503-21idleruntime-cro08:30:001
1612662995440,10cyclictest121ktimers/009:00:140
1612672995140,4cyclictest1715774-21kworker/u8:1+events_unbound12:11:023
161266299500,48cyclictest0-21swapper/009:40:120
1612665994926,20cyclictest231ktimers/112:10:131
1612672994835,11cyclictest391ktimers/307:20:123
1612665994739,5cyclictest1-21systemd09:00:231
1612665994636,6cyclictest1680363-21cut10:25:161
1612665994634,8cyclictest1698474-21grep11:15:261
1612665994615,26cyclictest0-21swapper/108:00:271
1612669994538,4cyclictest1653727-21systemd09:05:242
1612665994538,4cyclictest1643908-21sendmail08:40:001
1612662994538,5cyclictest1637312-21kworker/u8:1+events_unbound08:20:130
1612662994538,5cyclictest1637312-21kworker/u8:1+events_unbound08:20:120
161266599441,11cyclictest1675156-21/usr/sbin/munin10:10:141
1612662994436,5cyclictest1643560-21kworker/u8:0+events_unbound08:50:210
1612672994337,4cyclictest1683160-21kworker/u8:1+events_unbound10:40:503
1612672994333,6cyclictest208-21systemd-logind12:31:043
161266599431,9cyclictest1649863-21/usr/sbin/munin08:55:261
161266599431,10cyclictest1628782-21apt-get07:55:131
1612662994335,4cyclictest1716363-21seq12:10:160
1612662994326,14cyclictest1705721-21cron11:40:000
1612672994235,4cyclictest1692110-21sendmail11:00:003
1612672994219,5cyclictest131rcu_preempt10:50:133
161266599428,7cyclictest1616598-21sh07:20:011
1612665994232,6cyclictest1692094-21sendmail11:00:001
161266599422,9cyclictest1634977-21/usr/sbin/munin08:10:261
161266599422,9cyclictest1634977-21/usr/sbin/munin08:10:261
161266599421,9cyclictest1627211-21/usr/sbin/munin07:50:151
161266599421,8cyclictest1725528-21/usr/sbin/munin12:35:241
161266599421,8cyclictest1715800-21cron12:08:001
1612672994132,5cyclictest1637090-21sendmail08:20:003
1612669994134,4cyclictest1709154-21ls11:50:002
161266599418,6cyclictest1693902-21date11:05:011
1612665994133,6cyclictest231ktimers/108:40:131
1612665994132,7cyclictest231ktimers/110:45:141
161266599412,9cyclictest1683900-21df_inode10:35:141
161266599412,11cyclictest1683356-21munin-run10:35:001
1612665994114,23cyclictest1660716-21grep09:25:251
1612662994129,8cyclictest1708734-21grep11:45:250
1612672994032,4cyclictest1712576-21idleruntime-cro12:00:013
1612672994032,4cyclictest0-21swapper/308:35:183
1612669994029,7cyclictest1712547-21sh12:00:012
161266599401,12cyclictest1647223-21cron08:49:011
1612672993933,4cyclictest1678042-21kworker/u8:2+events_unbound10:30:503
1612672993930,5cyclictest1630259-21munin-plugin-st08:00:013
1612665993929,6cyclictest208-21systemd-logind09:10:241
161266599392,6cyclictest1623420-21cron07:40:011
161266599391,9cyclictest1717899-21/usr/sbin/munin12:15:211
161266599391,8cyclictest1662622-21cron09:32:011
161266599391,7cyclictest1670476-21grep09:55:221
161266599391,6cyclictest1669688-21cron09:55:011
161266599391,6cyclictest1640942-21fschecks_time08:30:171
161266599391,12cyclictest1714262-21cron12:05:001
1612665993911,22cyclictest1623662-21date07:40:021
161266599391,11cyclictest1620707-21meminfo07:30:181
161266599391,10cyclictest1626582-21taskset07:46:551
1612665993828,7cyclictest1721107-21cut12:25:001
161266599382,7cyclictest1613881-21grep07:10:241
161266599382,5cyclictest1616853-21/usr/sbin/munin07:20:251
161266599382,11cyclictest1636619-21tail08:15:261
161266599381,9cyclictest1707055-21users11:40:281
161266599381,9cyclictest1707055-21users11:40:271
161266599381,8cyclictest1705102-21/usr/sbin/munin11:35:251
161266599381,5cyclictest1677792-21head10:15:251
161266599381,14cyclictest1659003-21grep09:20:251
161266599381,14cyclictest1659003-21grep09:20:251
161266599381,10cyclictest1709145-21sh11:50:001
161266599381,10cyclictest1696217-21grep11:10:181
161266599380,8cyclictest438-21cron10:10:001
1612672993728,6cyclictest1652445-21munin-plugin-st09:05:013
1612669993725,8cyclictest1683554-21apt-key10:35:012
161266599373,5cyclictest1723146-21diskstats12:30:161
161266599372,6cyclictest1673114-21sh10:05:001
161266599372,5cyclictest1654337-21cron09:10:011
1612665993725,8cyclictest1619610-21grep07:25:281
161266599371,9cyclictest1686140-21processes10:40:231
161266599371,9cyclictest1667381-21ls09:45:251
161266599371,6cyclictest1700617-21cron11:25:001
161266599371,6cyclictest1694248-21grep11:05:161
161266599371,6cyclictest1664567-21cron09:40:011
161266599371,5cyclictest1689899-21tail10:50:261
1612665993711,23cyclictest0-21swapper/109:40:161
161266599371,10cyclictest1632260-21/usr/sbin/munin08:05:151
161266599370,10cyclictest1648031-21missed_timers08:50:211
1612672993628,4cyclictest0-21swapper/310:05:003
1612672993623,5cyclictest131rcu_preempt07:50:233
161266999368,10cyclictest1688944-21cpu10:50:142
1612669993630,3cyclictest0-21swapper/211:30:002
1612669993628,4cyclictest0-21swapper/208:30:162
1612669993627,5cyclictest0-21swapper/210:00:442
1612669993627,5cyclictest0-21swapper/209:15:002
161266599363,9cyclictest1656626-21irqstats09:15:201
161266599363,9cyclictest1656626-21irqstats09:15:201
161266599361,8cyclictest1721436-21/usr/sbin/munin12:25:151
161266599361,6cyclictest1702720-21fschecks_count11:30:161
161266599361,5cyclictest1701842-21grep11:25:241
1612662993627,4cyclictest0-21swapper/007:55:050
1612672993529,3cyclictest1702331-21kthreadd11:30:003
1612672993526,5cyclictest1705721-21cron11:40:003
1612672993516,12cyclictest131rcu_preempt08:50:243
1612672993515,6cyclictest131rcu_preempt09:25:113
1612672993515,5cyclictest131rcu_preempt10:25:243
161266599351,7cyclictest1679467-21grep10:20:241
161266599351,6cyclictest1709916-21ntp_kernel_pll_11:50:211
161266599351,6cyclictest1638204-21wc08:20:251
161266599351,6cyclictest1638204-21wc08:20:251
161267299349,8cyclictest40-21ksoftirqd/309:25:003
161267299349,8cyclictest40-21ksoftirqd/309:25:003
1612672993427,5cyclictest1671221-21kworker/u8:1+events_unbound10:14:413
1612672993426,4cyclictest0-21swapper/309:00:013
1612672993424,5cyclictest0-21swapper/308:00:273
1612672993414,13cyclictest131rcu_preempt09:35:003
1612662993423,7cyclictest1684828-21grep10:35:250
1612672993326,5cyclictest1678042-21kworker/u8:2+events_unbound10:35:063
1612672993324,6cyclictest0-21swapper/309:15:293
1612672993324,6cyclictest0-21swapper/309:15:283
1612672993315,6cyclictest131rcu_preempt10:45:123
1612672993315,11cyclictest1700387-21kworker/u8:2+events_unbound11:22:453
1612672993314,5cyclictest131rcu_preempt07:15:043
161266999338,6cyclictest32-21ksoftirqd/210:15:142
1612662993323,6cyclictest0-21swapper/012:05:000
161267299329,12cyclictest131rcu_preempt10:00:003
1612672993219,5cyclictest131rcu_preempt09:50:243
1612672993218,6cyclictest131rcu_preempt08:05:173
1612672993214,11cyclictest40-21ksoftirqd/310:20:003
1612672993213,5cyclictest131rcu_preempt07:15:013
1612672993212,11cyclictest131rcu_preempt11:15:213
1612669993225,4cyclictest1700619-21cron11:25:002
1612669993225,4cyclictest0-21swapper/207:45:142
1612669993224,5cyclictest0-21swapper/209:30:002
1612669993221,8cyclictest311ktimers/207:25:152
1612662993225,4cyclictest1617877-21unixbench_multi07:20:260
161267299317,14cyclictest1726247-21wc12:40:003
161267299314,11cyclictest40-21ksoftirqd/309:40:013
1612672993123,4cyclictest0-21swapper/311:10:003
1612672993116,7cyclictest1721038-21kworker/u8:2+events_unbound12:29:293
1612672993116,6cyclictest131rcu_preempt08:30:013
1612672993116,6cyclictest131rcu_preempt08:30:013
1612672993113,11cyclictest131rcu_preempt09:45:193
1612672993111,5cyclictest131rcu_preempt11:45:003
1612672993111,5cyclictest131rcu_preempt11:45:003
1612672993110,12cyclictest131rcu_preempt11:50:003
161266999318,6cyclictest32-21ksoftirqd/212:20:012
1612669993123,4cyclictest0-21swapper/208:00:012
1612669993122,4cyclictest0-21swapper/210:55:252
1612669993110,4cyclictest32-21ksoftirqd/209:20:252
1612669993110,4cyclictest32-21ksoftirqd/209:20:242
1612662993123,4cyclictest0-21swapper/008:15:260
1612662993122,6cyclictest1704017-21cron11:35:000
161267299309,13cyclictest40-21ksoftirqd/309:10:173
161267299309,12cyclictest40-21ksoftirqd/310:20:203
161267299308,12cyclictest40-21ksoftirqd/311:30:203
1612672993016,5cyclictest1717515-21kworker/u8:0+events_unbound12:22:123
161266999308,6cyclictest0-21swapper/209:50:162
1612669993023,3cyclictest131rcu_preempt09:00:182
1612669993019,7cyclictest1624712-21grep07:40:252
1612662993024,4cyclictest1692012-21kworker/u8:3+events_unbound11:05:530
1612662993023,4cyclictest1719382-21cron12:20:000
161267299299,4cyclictest0-21swapper/311:00:253
161267299298,14cyclictest40-21ksoftirqd/307:31:333
161267299297,13cyclictest40-21ksoftirqd/308:30:253
161267299297,12cyclictest40-21ksoftirqd/312:15:213
161267299296,12cyclictest40-21ksoftirqd/307:45:213
161267299296,11cyclictest40-21ksoftirqd/309:40:253
161267299292,8cyclictest40-21ksoftirqd/307:25:143
1612672992916,5cyclictest1624784-21kworker/u8:3+events_unbound07:42:403
1612672992911,5cyclictest131rcu_preempt09:05:253
1612672992911,11cyclictest131rcu_preempt08:20:233
1612672992911,11cyclictest131rcu_preempt08:20:233
1612672992910,12cyclictest131rcu_preempt12:05:233
1612672992910,11cyclictest40-21ksoftirqd/311:10:193
161266999298,12cyclictest32-21ksoftirqd/212:23:182
161266999297,7cyclictest32-21ksoftirqd/209:35:222
161266999296,7cyclictest1645694-21date08:45:002
1612669992912,12cyclictest0-21swapper/211:05:122
1612662992923,3cyclictest0-21swapper/012:30:260
1612662992922,4cyclictest0-21swapper/009:05:250
1612662992921,5cyclictest1669693-21sh09:55:010
1612662992920,5cyclictest0-21swapper/010:15:160
1612662992919,7cyclictest1623510-21cat07:40:010
1612662992919,7cyclictest0-21swapper/007:15:010
161267299289,12cyclictest40-21ksoftirqd/312:00:233
161267299288,12cyclictest131rcu_preempt11:50:143
161267299287,4cyclictest131rcu_preempt08:10:163
161267299287,4cyclictest131rcu_preempt08:10:163
1612672992816,5cyclictest131rcu_preempt07:35:143
1612672992812,5cyclictest131rcu_preempt10:05:173
1612672992810,12cyclictest131rcu_preempt08:40:243
161266999289,5cyclictest32-21ksoftirqd/212:33:222
161266999289,5cyclictest32-21ksoftirqd/212:08:162
161266999288,12cyclictest438-21cron10:46:002
1612669992821,4cyclictest1671405-21munin-run10:00:002
1612669992818,6cyclictest0-21swapper/207:20:022
1612669992815,6cyclictest131rcu_preempt10:44:182
1612669992815,10cyclictest1642883-21missed_timers08:35:202
1612662992821,5cyclictest1692012-21kworker/u8:3+events_unbound11:15:540
1612662992821,3cyclictest0-21swapper/010:40:250
1612662992820,4cyclictest13550irq/42-30be0000.ethernet10:05:000
161266299281,6cyclictest16163032sleep007:16:320
1612662992810,5cyclictest0-21swapper/011:40:160
1612662992810,5cyclictest0-21swapper/011:40:160
161267299279,11cyclictest131rcu_preempt08:45:243
161266999278,6cyclictest32-21ksoftirqd/209:40:262
161266999277,5cyclictest32-21ksoftirqd/209:30:222
161266999275,4cyclictest0-21swapper/208:50:242
1612669992721,3cyclictest0-21swapper/210:10:272
1612669992719,4cyclictest0-21swapper/210:20:252
1612669992718,6cyclictest311ktimers/207:36:192
1612669992717,7cyclictest1632879-21/usr/sbin/munin08:05:252
1612669992717,3cyclictest131rcu_preempt09:17:162
1612669992717,3cyclictest131rcu_preempt09:17:162
161266299277,10cyclictest1674692-21kworker/u8:0+events_unbound10:20:170
1612662992721,4cyclictest1637312-21kworker/u8:1+events_unbound08:44:170
1612662992720,3cyclictest0-21swapper/010:00:000
1612662992718,6cyclictest1712083-21unixbench_multi11:55:260
1612662992716,9cyclictest1612654-21cyclictest07:25:150
161266299271,4cyclictest131rcu_preempt12:20:130
1612662992714,8cyclictest204-21dbus-daemon09:35:300
161266999268,5cyclictest0-21swapper/211:41:452
161266999268,5cyclictest0-21swapper/211:41:452
161266999266,7cyclictest0-21swapper/212:25:212
161266999266,4cyclictest0-21swapper/211:30:152
1612669992616,7cyclictest1639168-21fschecks_count08:25:172
1612669992616,7cyclictest1639168-21fschecks_count08:25:162
161266999261,10cyclictest645-21runrttasks11:52:052
1612669992610,8cyclictest131rcu_preempt09:47:342
1612669992610,6cyclictest131rcu_preempt08:15:182
1612662992621,3cyclictest1678042-21kworker/u8:2-ext4-rsv-conversion10:30:010
1612662992620,4cyclictest1619686-21kworker/u8:0+events_unbound07:50:020
1612662992620,3cyclictest13550irq/42-30be0000.ethernet11:00:170
1612662992619,4cyclictest1676519-21auditctl10:15:000
1612662992619,3cyclictest0-21swapper/008:35:170
1612662992614,9cyclictest1668008-21basename09:50:010
1612662992614,8cyclictest0-21swapper/009:20:010
1612662992614,8cyclictest0-21swapper/009:20:000
1612662992610,14cyclictest121ktimers/009:30:010
1612669992518,4cyclictest0-21swapper/208:45:242
1612669992516,6cyclictest311ktimers/211:38:442
1612669992512,10cyclictest1693516-21sshd11:01:362
1612669992511,11cyclictest1680292-21/usr/sbin/munin10:25:152
1612669992510,8cyclictest131rcu_preempt08:59:582
1612662992518,5cyclictest1723018-21kworker/u8:0+events_unbound12:36:050
1612662992518,3cyclictest0-21swapper/009:10:170
1612662992517,4cyclictest0-21swapper/011:20:170
1612662992514,8cyclictest1630610-21df08:00:150
161266299251,20cyclictest0-21swapper/010:31:550
161266999246,9cyclictest32-21ksoftirqd/212:00:252
1612669992416,5cyclictest311ktimers/212:35:182
1612669992414,7cyclictest1696169-21/usr/sbin/munin11:10:172
1612669992412,9cyclictest1635455-21cat08:15:012
1612669992412,9cyclictest1635455-21cat08:15:012
161266999241,17cyclictest0-21swapper/207:21:582
1612669992411,6cyclictest131rcu_preempt12:11:482
161266299242,3cyclictest1623800-21diskstats07:40:150
1612662992416,5cyclictest0-21swapper/009:00:010
1612662992413,7cyclictest11-21ksoftirqd/008:45:210
161266299240,3cyclictest131rcu_preempt07:50:010
161266999238,12cyclictest1673924-21/usr/sbin/munin10:05:222
161266999237,4cyclictest0-21swapper/208:20:202
161266999237,4cyclictest0-21swapper/208:20:202
161266999236,14cyclictest1698127-21fgrep11:15:232
1612669992316,3cyclictest0-21swapper/208:00:172
1612669992310,10cyclictest1684923-21cron10:36:002
1612662992318,3cyclictest0-21swapper/010:50:140
1612662992316,3cyclictest0-21swapper/011:10:250
1612662992316,3cyclictest0-21swapper/008:25:020
1612662992316,3cyclictest0-21swapper/008:25:020
161266299231,12cyclictest0-21swapper/011:27:000
161266299230,19cyclictest0-21swapper/011:51:520
161266299230,19cyclictest0-21swapper/010:57:590
161266299230,19cyclictest0-21swapper/008:11:460
161266299230,19cyclictest0-21swapper/008:11:460
161266999220,11cyclictest0-21swapper/207:30:102
1612662992216,3cyclictest0-21swapper/012:10:010
1612662992215,4cyclictest1658216-21fschecks_time09:20:160
1612662992215,4cyclictest1658216-21fschecks_time09:20:160
161266299221,19cyclictest1612654-21cyclictest07:30:140
161266299221,19cyclictest0-21swapper/012:25:180
161266299221,19cyclictest0-21swapper/010:45:470
161266299220,20cyclictest0-21swapper/010:05:110
161266299220,20cyclictest0-21swapper/008:33:500
161266299219,9cyclictest1662417-21grep09:30:260
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional