You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-28 - 23:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Thu May 28, 2026 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1694701996029,5cyclictest0-21swapper/107:20:011
1694701995849,5cyclictest1788840-21sendmail11:40:011
1694702995241,7cyclictest1790309-21grep11:40:232
1694700995245,5cyclictest1756714-21kworker/u8:1+events_unbound10:20:190
1694700995245,5cyclictest1736083-21kworker/u8:0+events_unbound09:25:120
1694702995142,5cyclictest1-21systemd10:20:182
1694702994941,4cyclictest1734711-21munin-plugin-st09:05:002
1694702994932,13cyclictest311ktimers/209:10:092
1694701994938,7cyclictest1805670-21grep12:25:261
1694701994840,5cyclictest1747889-21grep09:40:251
1694701994738,6cyclictest1719332-21cron08:20:011
1694701994737,6cyclictest204-21dbus-daemon11:00:241
1694700994525,8cyclictest131rcu_preempt10:45:110
1694703994434,6cyclictest1743228-21auditctl09:30:013
1694700994431,5cyclictest1761923-21kworker/u8:3+events_unbound10:40:220
1694703994335,4cyclictest0-21swapper/312:40:003
1694703994331,9cyclictest391ktimers/309:05:103
1694702994335,4cyclictest1792462-21apt11:50:002
1694700994131,6cyclictest1-21systemd10:10:160
1694702994029,7cyclictest1736396-21cron09:10:012
1694702994028,8cyclictest1708903-21idleruntime-cro07:50:012
1694702994028,8cyclictest1708903-21idleruntime-cro07:50:012
1694701994032,4cyclictest0-21swapper/110:55:231
1694703993932,5cyclictest145-21jbd2/mmcblk1p2-808:55:063
1694700993928,8cyclictest1708482-21runrttasks07:45:250
1694700993928,8cyclictest1708482-21runrttasks07:45:240
1694702993831,4cyclictest1753423-21kworker/u8:1-ext4-rsv-conversion10:00:012
1694702993829,4cyclictest0-21swapper/212:20:152
1694702993826,8cyclictest1798847-21grep12:05:232
1694701993830,4cyclictest0-21swapper/111:15:251
1694703993731,4cyclictest1727620-21kworker/u8:3+events_unbound10:15:173
1694703993731,4cyclictest1706924-21kworker/u8:3+events_unbound07:49:433
1694703993731,4cyclictest1706924-21kworker/u8:3+events_unbound07:49:433
1694703993727,6cyclictest0-21swapper/312:20:013
1694703993725,9cyclictest438-21cron08:10:013
169470099371,9cyclictest11-21ksoftirqd/011:50:120
169470099371,9cyclictest11-21ksoftirqd/011:50:110
169470099371,9cyclictest11-21ksoftirqd/009:35:110
1694703993627,5cyclictest1700373-21cron07:25:013
1694703993627,5cyclictest1700373-21cron07:25:013
1694703993626,7cyclictest1733378-21fschecks_count09:00:143
1694703993626,6cyclictest1770680-21grep10:45:243
1694703993625,8cyclictest1797996-21fschecks_time12:05:153
1694702993629,4cyclictest1-21systemd10:55:232
1694702993626,6cyclictest0-21swapper/208:30:252
1694702993610,9cyclictest32-21ksoftirqd/208:05:162
169470099361,10cyclictest11-21ksoftirqd/008:55:120
1694703993528,4cyclictest1746637-21munin-plugin-st09:39:593
1694703993524,8cyclictest1795885-21sendmail11:59:593
1694702993527,3cyclictest0-21swapper/212:15:152
1694701993525,7cyclictest1807319-21grep12:30:231
1694700993525,7cyclictest1760510-21sendmail10:20:010
1694700993524,7cyclictest1807337-21grep12:30:230
169470099351,9cyclictest11-21ksoftirqd/011:40:120
1694700993512,7cyclictest131rcu_preempt10:50:110
1694703993426,4cyclictest0-21swapper/308:00:013
1694702993426,4cyclictest0-21swapper/211:00:242
1694701993426,4cyclictest0-21swapper/111:25:251
1694701993424,6cyclictest0-21swapper/108:55:001
1694701993424,6cyclictest0-21swapper/108:54:591
1694701993423,7cyclictest1712032-21grep07:55:251
1694700993426,4cyclictest0-21swapper/011:00:010
1694700993418,7cyclictest1754025-21kworker/u8:2+events_unbound10:07:590
1694700993411,5cyclictest131rcu_preempt11:30:120
1694700993410,5cyclictest131rcu_preempt09:50:120
1694702993326,4cyclictest1786701-21unixbench_singl11:30:242
1694702993326,3cyclictest0-21swapper/210:30:252
1694702993324,6cyclictest1783314-21grep11:20:262
1694702993323,7cyclictest311ktimers/210:30:012
1694702993322,5cyclictest131rcu_preempt12:29:492
1694702993321,7cyclictest1760090-21grep10:15:252
1694702993319,4cyclictest131rcu_preempt11:27:222
1694702993317,6cyclictest1778300-21kworker/u8:0+events_unbound11:11:082
1694702993316,3cyclictest131rcu_preempt10:10:392
1694701993324,6cyclictest0-21swapper/110:00:021
1694701993324,5cyclictest0-21swapper/108:10:001
1694700993326,4cyclictest0-21swapper/010:40:000
1694700993324,5cyclictest1800335-21switchtime12:10:230
169470099331,8cyclictest11-21ksoftirqd/010:00:110
1694703993224,5cyclictest1776491-21kworker/u8:3+events_unbound11:05:243
1694703993222,6cyclictest0-21swapper/307:54:593
169470299324,7cyclictest32-21ksoftirqd/209:25:152
1694702993222,4cyclictest131rcu_preempt12:36:522
1694702993214,9cyclictest131rcu_preempt07:15:232
1694700993224,6cyclictest151rcuc/011:15:130
1694700993224,5cyclictest151rcuc/008:15:120
1694700993223,4cyclictest0-21swapper/011:10:000
1694700993221,5cyclictest131rcu_preempt11:05:000
169470099321,9cyclictest11-21ksoftirqd/012:35:120
1694700993218,4cyclictest1741499-21kworker/u8:2+events_unbound09:49:290
1694703993123,4cyclictest0-21swapper/311:50:163
1694703993123,4cyclictest0-21swapper/311:50:153
1694703993123,4cyclictest0-21swapper/311:10:163
1694703993123,4cyclictest0-21swapper/308:25:013
1694703993121,7cyclictest0-21swapper/307:34:593
1694703993121,7cyclictest0-21swapper/307:34:593
169470299315,6cyclictest32-21ksoftirqd/211:05:252
1694702993121,7cyclictest311ktimers/207:55:002
1694702993121,6cyclictest0-21swapper/211:55:232
1694702993121,4cyclictest131rcu_preempt09:23:242
1694702993116,3cyclictest131rcu_preempt09:35:472
1694702993114,9cyclictest131rcu_preempt11:35:382
1694701993123,5cyclictest0-21swapper/111:05:251
1694701993123,4cyclictest0-21swapper/110:10:001
1694701993123,4cyclictest0-21swapper/108:10:251
1694701993123,4cyclictest0-21swapper/107:40:161
1694701993122,6cyclictest231ktimers/111:10:121
1694701993121,7cyclictest1720625-21grep08:20:261
1694701993121,6cyclictest0-21swapper/112:35:241
1694701993121,6cyclictest0-21swapper/112:05:151
1694701993120,7cyclictest1802226-21grep12:15:231
169470099318,13cyclictest11-21ksoftirqd/011:45:140
1694700993118,5cyclictest1786986-21kworker/u8:1+events_unbound11:35:560
169470099311,3cyclictest0-21swapper/009:05:120
1694700993111,7cyclictest1753498-21grep10:00:000
1694703993022,6cyclictest1727620-21kworker/u8:3+events_unbound10:10:183
1694703993022,4cyclictest0-21swapper/310:35:243
1694703993021,5cyclictest0-21swapper/308:35:263
1694703993014,6cyclictest1727620-21kworker/u8:3+events_unbound08:47:003
1694703993014,6cyclictest1727620-21kworker/u8:3+events_unbound08:46:593
169470299305,5cyclictest32-21ksoftirqd/207:50:242
169470299305,5cyclictest32-21ksoftirqd/207:45:012
169470299304,5cyclictest32-21ksoftirqd/210:50:152
169470299303,7cyclictest32-21ksoftirqd/209:15:232
1694702993020,8cyclictest311ktimers/207:25:252
1694702993020,7cyclictest311ktimers/208:55:152
1694702993020,4cyclictest131rcu_preempt08:50:502
1694702993020,4cyclictest131rcu_preempt08:50:492
1694702993019,8cyclictest311ktimers/209:45:262
1694702993019,3cyclictest131rcu_preempt08:05:002
1694702993018,3cyclictest131rcu_preempt07:30:132
1694702993018,3cyclictest131rcu_preempt07:30:132
1694702993017,5cyclictest131rcu_preempt08:43:052
1694702993016,5cyclictest131rcu_preempt10:38:032
1694702993015,9cyclictest131rcu_preempt09:43:152
1694702993014,3cyclictest131rcu_preempt08:13:432
1694702993013,4cyclictest1755726-21df_inode10:05:132
1694702993013,14cyclictest311ktimers/210:45:472
1694702993010,7cyclictest1753813-21sed10:00:022
1694702993010,3cyclictest131rcu_preempt11:53:492
1694702993010,3cyclictest131rcu_preempt11:53:492
1694701993023,4cyclictest0-21swapper/110:35:011
1694701993022,5cyclictest1795444-21head11:55:231
1694701993021,4cyclictest0-21swapper/107:14:311
1694701993020,7cyclictest1705490-21munin-plugin-st07:40:011
1694701993018,8cyclictest1-21systemd08:04:521
169470099307,11cyclictest11-21ksoftirqd/008:05:010
1694700993022,4cyclictest0-21swapper/009:10:240
1694700993021,7cyclictest1729623-21latency_hist08:50:010
1694700993021,7cyclictest1729623-21latency_hist08:50:000
1694700993021,6cyclictest1703336-21unixbench_multi07:30:250
1694700993021,6cyclictest1703336-21unixbench_multi07:30:240
1694700993018,8cyclictest1797203-21sshd12:00:290
1694700993016,10cyclictest121ktimers/010:30:110
1694700993012,5cyclictest131rcu_preempt11:20:120
1694700993010,4cyclictest0-21swapper/009:18:010
1694703992922,4cyclictest0-21swapper/310:00:013
1694703992922,4cyclictest0-21swapper/309:20:263
1694703992922,4cyclictest0-21swapper/307:40:253
1694703992921,6cyclictest1737692-21unixbench_singl09:10:243
1694703992921,5cyclictest0-21swapper/308:05:013
1694703992921,4cyclictest0-21swapper/308:20:003
1694703992919,6cyclictest0-21swapper/311:00:013
169470299293,7cyclictest32-21ksoftirqd/212:10:182
1694702992920,7cyclictest311ktimers/212:30:132
1694702992918,8cyclictest311ktimers/208:35:512
1694702992918,7cyclictest0-21swapper/207:20:282
1694702992918,7cyclictest0-21swapper/207:20:272
1694702992918,5cyclictest131rcu_preempt08:16:152
1694702992914,9cyclictest131rcu_preempt12:04:062
1694702992914,9cyclictest131rcu_preempt07:11:182
1694702992914,7cyclictest1774487-21kworker/u8:2+events_unbound11:18:302
1694702992914,4cyclictest131rcu_preempt09:30:262
1694701992920,5cyclictest0-21swapper/110:35:241
1694700992923,4cyclictest1706924-21kworker/u8:3+events_unbound07:59:520
1694700992923,3cyclictest1726152-21cron08:40:010
1694700992914,4cyclictest1788793-21kworker/u8:3-events_freezable_power_12:07:410
1694700992914,4cyclictest131rcu_preempt08:20:130
169470099291,16cyclictest0-21swapper/007:51:440
169470099291,10cyclictest11-21ksoftirqd/007:15:130
1694703992821,3cyclictest0-21swapper/310:40:243
1694703992820,4cyclictest0-21swapper/312:30:143
1694703992819,7cyclictest0-21swapper/311:40:013
1694702992813,3cyclictest131rcu_preempt10:40:112
1694701992821,3cyclictest0-21swapper/110:50:011
1694701992821,3cyclictest0-21swapper/107:45:251
1694701992821,3cyclictest0-21swapper/107:45:241
169470099288,11cyclictest131rcu_preempt09:40:260
1694700992821,4cyclictest1806113-21idleruntime-cro12:30:010
1694700992819,3cyclictest131rcu_preempt07:22:040
1694700992819,3cyclictest131rcu_preempt07:22:040
1694700992818,6cyclictest0-21swapper/007:45:010
1694700992817,6cyclictest0-21swapper/007:35:230
1694700992814,3cyclictest131rcu_preempt12:20:010
1694700992810,11cyclictest11-21ksoftirqd/009:34:590
1694703992721,4cyclictest1763913-21kthreadd10:30:013
1694703992720,4cyclictest0-21swapper/309:50:253
1694703992720,3cyclictest0-21swapper/308:35:013
1694703992717,6cyclictest0-21swapper/309:20:013
1694702992716,8cyclictest301rcuc/208:24:312
1694702992712,3cyclictest131rcu_preempt09:50:482
1694702992711,4cyclictest131rcu_preempt08:45:142
1694702992711,4cyclictest131rcu_preempt08:45:132
1694702992710,4cyclictest131rcu_preempt07:35:082
1694701992720,4cyclictest0-21swapper/107:20:271
1694701992720,4cyclictest0-21swapper/107:20:261
1694701992718,6cyclictest0-21swapper/109:20:251
1694701992716,7cyclictest0-21swapper/108:59:591
1694700992720,3cyclictest0-21swapper/012:20:230
1694700992719,5cyclictest1713930-21kworker/u8:1+events_unbound08:05:090
169470099271,14cyclictest0-21swapper/011:10:220
1694700992710,3cyclictest0-21swapper/007:29:000
1694703992620,4cyclictest1727620-21kworker/u8:3+events_unbound09:46:423
1694703992619,5cyclictest1727620-21kworker/u8:3+events_unbound10:00:253
1694703992612,7cyclictest40-21ksoftirqd/311:25:153
1694703992612,11cyclictest40-21ksoftirqd/308:10:143
169470299266,5cyclictest32-21ksoftirqd/208:25:222
1694701992619,4cyclictest0-21swapper/110:00:251
1694701992618,5cyclictest1790363-21grep11:40:251
1694701992617,7cyclictest231ktimers/110:10:121
1694701992617,6cyclictest1803463-21awk12:20:201
1694701992616,5cyclictest0-21swapper/109:45:221
1694700992621,3cyclictest1717577-21kworker/u8:1-events_freezable_power_08:14:390
1694700992611,6cyclictest11-21ksoftirqd/008:30:150
169470099261,13cyclictest0-21swapper/007:12:450
1694700992610,6cyclictest11-21ksoftirqd/011:25:240
1694703992519,3cyclictest0-21swapper/311:00:183
1694703992517,4cyclictest0-21swapper/310:05:233
1694703992516,7cyclictest1797262-21kworker/u8:0+events_unbound12:02:553
1694703992516,6cyclictest0-21swapper/312:20:243
1694703992512,10cyclictest1694698-21cyclictest10:30:113
1694701992517,5cyclictest231ktimers/111:45:211
1694701992516,6cyclictest231ktimers/108:50:011
1694701992516,6cyclictest231ktimers/108:50:011
1694701992514,8cyclictest1763383-21sed10:25:231
169470099258,7cyclictest11-21ksoftirqd/008:40:150
169470099251,15cyclictest0-21swapper/010:28:470
169470099251,13cyclictest0-21swapper/011:57:550
1694700992511,12cyclictest11-21ksoftirqd/009:01:570
1694703992418,4cyclictest1781648-21kworker/u8:3+events_unbound11:20:403
1694703992418,4cyclictest1770993-21kworker/u8:1+events_unbound10:50:143
1694703992418,3cyclictest0-21swapper/309:40:223
1694703992418,3cyclictest0-21swapper/307:10:193
1694701992418,3cyclictest0-21swapper/112:10:181
1694701992415,6cyclictest0-21swapper/110:55:001
1694701992415,5cyclictest0-21swapper/110:40:241
169470099241,19cyclictest1730820-21grep08:50:260
169470099241,19cyclictest1730820-21grep08:50:260
1694703992317,4cyclictest1700255-21kworker/u8:0+events_unbound08:26:333
1694703992317,3cyclictest0-21swapper/307:35:143
1694703992317,3cyclictest0-21swapper/307:15:243
1694703992314,6cyclictest0-21swapper/308:55:003
1694703992314,6cyclictest0-21swapper/308:55:003
1694703992313,7cyclictest1701060-21memory07:25:193
1694703992312,7cyclictest1789413-21/usr/sbin/munin11:40:143
1694701992316,4cyclictest0-21swapper/110:15:231
1694701992316,3cyclictest0-21swapper/111:20:241
1694701992315,5cyclictest645-21runrttasks07:25:111
1694701992314,5cyclictest1744511-21grep09:30:261
1694701992313,6cyclictest0-21swapper/109:00:251
1694701992312,6cyclictest0-21swapper/108:30:251
169470099231,14cyclictest0-21swapper/008:26:060
169470399223,5cyclictest1787328-21latency_hist11:35:003
1694703992216,4cyclictest1783586-21kworker/u8:0+events_unbound11:45:053
1694703992215,4cyclictest0-21swapper/312:10:233
1694703992210,8cyclictest204-21dbus-daemon08:40:043
1694701992216,3cyclictest1750517-21fschecks_time09:50:151
1694701992216,3cyclictest0-21swapper/108:40:211
1694701992214,6cyclictest231ktimers/110:20:131
1694701992212,7cyclictest0-21swapper/108:25:161
1694703992115,4cyclictest0-21swapper/310:20:273
1694701992115,3cyclictest0-21swapper/107:50:181
1694701992111,6cyclictest1785889-21seq11:30:151
1694701992110,7cyclictest1725732-21grep08:35:251
1694703992015,3cyclictest0-21swapper/309:30:243
1694703992010,7cyclictest0-21swapper/312:25:253
1694701992014,3cyclictest0-21swapper/107:30:161
1694701992014,3cyclictest0-21swapper/107:30:161
1694701992013,5cyclictest231ktimers/109:25:111
1694701992012,5cyclictest0-21swapper/109:05:251
169470199195,3cyclictest0-21swapper/109:36:211
1694701991812,3cyclictest0-21swapper/109:15:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional