You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-26 - 19:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s (updated Thu Mar 26, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1708990995448,4cyclictest1775429-21kworker/u8:1+events_unbound10:15:423
1708982995136,11cyclictest231ktimers/111:10:111
1708985994942,4cyclictest1731688-21munin-plugin-st08:15:002
1708985994940,5cyclictest1786036-21cron10:50:002
1708979994942,5cyclictest1710234-21kworker/u8:2+events_unbound07:15:030
1708985994838,6cyclictest204-21dbus-daemon07:15:022
1708979994640,4cyclictest1775429-21kworker/u8:1+events_unbound10:25:460
1708982994434,7cyclictest1740647-21sendmail08:40:011
1708990994334,7cyclictest391ktimers/311:05:113
1708985994333,6cyclictest1784337-21cron10:45:002
1708990994232,5cyclictest1753205-21cut09:15:173
1708985994228,10cyclictest311ktimers/210:10:112
1708982994234,5cyclictest1782621-21cron10:40:001
1708990994129,9cyclictest391ktimers/307:25:133
1708982994130,7cyclictest1711017-21sort07:15:031
1708979994033,4cyclictest1752789-21cron09:15:010
1708990993931,4cyclictest1740619-21cron08:40:013
1708990993931,4cyclictest0-21swapper/310:15:003
1708990993929,7cyclictest1770037-21grep10:00:243
1708982993916,14cyclictest0-21swapper/112:05:011
1708979993932,5cyclictest1816947-21auditctl12:20:000
1708990993829,6cyclictest1781344-21fschecks_time10:35:153
1708990993730,4cyclictest0-21swapper/309:50:263
1708985993725,8cyclictest1764952-21idleruntime-cro09:50:002
1708982993718,4cyclictest131rcu_preempt11:40:141
1708979993730,5cyclictest151rcuc/010:55:100
1708979993730,5cyclictest151rcuc/010:55:100
1708979993727,7cyclictest1740622-21cron08:40:020
1708985993628,4cyclictest0-21swapper/211:30:162
170898299367,18cyclictest24-21ksoftirqd/107:30:001
1708982993628,6cyclictest231ktimers/110:30:121
1708982993628,4cyclictest1779234-21munin-plugin-st10:30:001
1708979993628,5cyclictest1810130-21sendmail11:59:590
1708979993628,4cyclictest0-21swapper/010:10:150
170897999361,5cyclictest0-21swapper/007:50:130
170899099355,11cyclictest0-21swapper/307:15:013
1708990993527,4cyclictest0-21swapper/309:45:173
1708990993524,7cyclictest1743812-21grep08:45:243
170898299356,15cyclictest24-21ksoftirqd/112:35:241
1708982993528,3cyclictest0-21swapper/109:25:011
1708982993527,4cyclictest0-21swapper/107:30:241
1708982993525,6cyclictest1800932-21grep11:30:251
1708982993523,9cyclictest1796273-21cron11:20:001
1708982993523,5cyclictest131rcu_preempt07:59:271
1708982993522,5cyclictest131rcu_preempt12:06:531
1708979993529,4cyclictest1801047-21kworker/u8:3+events_unbound11:35:520
1708979993529,4cyclictest1757755-21kworker/u8:0+events_unbound10:05:440
1708979993526,6cyclictest1754520-21sendmail09:20:000
1708979993522,10cyclictest151rcuc/012:00:130
1708990993426,4cyclictest0-21swapper/311:35:253
1708985993425,6cyclictest1790744-21unixbench_singl11:00:252
1708985993424,7cyclictest1770490-21auditctl10:05:002
1708985993424,6cyclictest0-21swapper/208:20:002
170898299347,8cyclictest24-21ksoftirqd/109:25:201
1708982993427,4cyclictest0-21swapper/112:20:001
1708982993425,4cyclictest0-21swapper/108:20:001
1708979993426,4cyclictest0-21swapper/012:30:260
1708979993426,4cyclictest0-21swapper/008:30:000
1708979993426,4cyclictest0-21swapper/008:30:000
1708979993425,5cyclictest1742956-21fschecks_count08:45:150
1708979993424,6cyclictest0-21swapper/008:25:000
1708979993424,6cyclictest0-21swapper/008:25:000
1708979993419,12cyclictest13550irq/42-30be0000.ethernet07:45:120
170899099337,14cyclictest40-21ksoftirqd/312:05:003
170899099335,15cyclictest40-21ksoftirqd/307:40:243
1708990993326,4cyclictest0-21swapper/312:20:003
1708990993325,4cyclictest0-21swapper/308:20:333
1708990993325,4cyclictest0-21swapper/308:20:323
1708990993324,6cyclictest1772187-21sh10:10:003
1708990993317,5cyclictest131rcu_preempt11:57:223
1708990993314,6cyclictest1766645-21apt-get09:55:063
1708985993324,5cyclictest0-21swapper/207:45:162
170898299336,13cyclictest24-21ksoftirqd/108:25:011
170898299336,13cyclictest24-21ksoftirqd/108:25:011
1708982993326,4cyclictest0-21swapper/107:50:251
1708982993322,4cyclictest131rcu_preempt10:48:021
1708982993321,7cyclictest0-21swapper/109:15:181
1708982993321,5cyclictest131rcu_preempt11:46:461
1708982993321,4cyclictest131rcu_preempt08:34:151
1708982993317,4cyclictest131rcu_preempt10:02:081
1708982993316,5cyclictest131rcu_preempt08:10:231
1708982993316,4cyclictest131rcu_preempt10:50:251
1708982993316,4cyclictest131rcu_preempt10:50:251
1708979993322,7cyclictest0-21swapper/009:05:250
1708990993225,3cyclictest0-21swapper/312:10:253
1708990993222,6cyclictest1714173-21unixbench_multi07:20:243
1708985993223,6cyclictest1811840-21sh12:05:002
170898299327,5cyclictest24-21ksoftirqd/108:30:021
170898299327,4cyclictest231ktimers/109:10:011
1708982993224,4cyclictest0-21swapper/110:15:161
1708982993224,4cyclictest0-21swapper/107:50:001
1708982993224,4cyclictest0-21swapper/107:40:251
1708982993222,7cyclictest221rcuc/111:50:161
1708982993222,6cyclictest0-21swapper/110:10:241
1708982993217,5cyclictest131rcu_preempt11:39:011
1708982993217,5cyclictest131rcu_preempt10:55:141
1708982993217,5cyclictest131rcu_preempt10:55:131
1708982993216,10cyclictest131rcu_preempt10:20:111
1708982993213,5cyclictest131rcu_preempt11:55:101
1708982993213,10cyclictest131rcu_preempt08:45:171
1708979993226,4cyclictest1772046-21kworker/u8:3+events_unbound10:35:470
1708979993226,3cyclictest1764954-21latency_hist09:50:000
1708979993225,3cyclictest0-21swapper/010:45:260
1708979993224,4cyclictest0-21swapper/012:35:570
1708979993218,4cyclictest1775429-21kworker/u8:1+events_unbound10:23:200
170899099319,6cyclictest40-21ksoftirqd/307:15:023
170899099317,5cyclictest40-21ksoftirqd/309:25:013
1708990993123,5cyclictest1708970-21cyclictest08:55:363
1708990993123,5cyclictest0-21swapper/308:20:003
1708990993122,5cyclictest0-21swapper/308:10:003
1708990993121,7cyclictest1788988-21grep10:55:233
1708990993121,7cyclictest1788988-21grep10:55:233
1708990993119,9cyclictest1796282-21ls11:20:003
1708990993116,8cyclictest1749110-21kworker/u8:1-events_freezable_power_09:33:533
1708985993124,4cyclictest0-21swapper/209:40:262
1708985993124,3cyclictest0-21swapper/211:35:242
1708985993123,4cyclictest0-21swapper/209:20:162
1708985993123,4cyclictest0-21swapper/208:45:252
170898299319,12cyclictest0-21swapper/111:20:171
170898299318,4cyclictest231ktimers/108:40:301
170898299317,9cyclictest24-21ksoftirqd/107:15:011
170898299316,7cyclictest24-21ksoftirqd/108:05:191
1708982993123,4cyclictest0-21swapper/111:05:221
1708982993123,4cyclictest0-21swapper/109:50:161
1708982993117,4cyclictest131rcu_preempt08:05:011
1708982993116,9cyclictest131rcu_preempt09:42:381
1708982993114,4cyclictest131rcu_preempt09:55:021
1708982993114,4cyclictest131rcu_preempt07:38:181
1708982993113,5cyclictest131rcu_preempt12:10:201
1708982993113,4cyclictest131rcu_preempt09:38:071
1708982993112,11cyclictest131rcu_preempt12:20:381
1708979993123,4cyclictest1749396-21munin-plugin-st09:05:020
1708979993123,4cyclictest0-21swapper/011:20:240
1708979993121,6cyclictest0-21swapper/007:10:240
170899099309,4cyclictest131rcu_preempt11:45:003
170899099307,6cyclictest381rcuc/307:35:213
1708990993023,5cyclictest1804649-21kworker/u8:1+events_unbound11:47:113
1708990993023,4cyclictest0-21swapper/310:30:163
1708990993022,4cyclictest0-21swapper/311:15:003
1708990993022,4cyclictest0-21swapper/309:35:233
1708990993020,6cyclictest0-21swapper/308:00:243
1708990993013,4cyclictest391ktimers/312:25:563
1708990993013,10cyclictest131rcu_preempt12:33:343
1708990993011,7cyclictest131rcu_preempt09:28:173
1708985993023,4cyclictest1799692-21kthreadd11:30:002
1708985993021,6cyclictest1726099-21unixbench_multi07:55:242
1708985993016,11cyclictest1708970-21cyclictest10:30:132
170898599301,25cyclictest311ktimers/211:15:222
170898299308,4cyclictest231ktimers/111:25:211
170898299302,18cyclictest24-21ksoftirqd/109:30:251
1708982993020,7cyclictest231ktimers/108:30:001
1708982993019,5cyclictest131rcu_preempt09:10:221
1708982993016,9cyclictest131rcu_preempt12:25:211
1708982993015,5cyclictest131rcu_preempt11:04:571
1708982993012,5cyclictest131rcu_preempt08:55:241
1708982993012,5cyclictest131rcu_preempt08:50:171
1708982993012,3cyclictest131rcu_preempt12:34:211
170897999303,6cyclictest131rcu_preempt12:05:120
170897999300,6cyclictest11-21ksoftirqd/010:15:120
170899099293,5cyclictest381rcuc/308:30:003
170899099293,5cyclictest381rcuc/308:30:003
1708990992923,3cyclictest0-21swapper/312:05:163
1708990992922,4cyclictest0-21swapper/310:50:193
1708990992922,4cyclictest0-21swapper/310:50:183
1708990992922,4cyclictest0-21swapper/309:40:263
1708990992922,4cyclictest0-21swapper/307:50:263
1708990992921,4cyclictest0-21swapper/310:40:253
1708990992921,4cyclictest0-21swapper/310:25:243
1708990992914,9cyclictest391ktimers/307:55:123
1708985992923,3cyclictest0-21swapper/208:20:262
1708985992923,3cyclictest0-21swapper/208:20:252
1708985992922,3cyclictest0-21swapper/210:15:252
1708985992921,4cyclictest0-21swapper/210:50:482
1708985992921,4cyclictest0-21swapper/210:50:482
1708985992921,4cyclictest0-21swapper/207:50:182
170898599291,9cyclictest1716757-21fschecks_time07:30:152
1708985992919,8cyclictest1808223-21cut11:55:002
170898299296,6cyclictest24-21ksoftirqd/109:45:391
1708982992917,4cyclictest131rcu_preempt10:40:201
1708982992916,4cyclictest131rcu_preempt10:05:211
1708979992922,3cyclictest0-21swapper/008:05:240
1708979992921,4cyclictest0-21swapper/008:40:300
1708979992916,8cyclictest0-21swapper/008:55:150
170897999290,5cyclictest131rcu_preempt08:00:120
170899099283,16cyclictest40-21ksoftirqd/311:30:113
1708990992822,3cyclictest0-21swapper/308:30:333
1708990992817,8cyclictest391ktimers/312:35:203
1708990992812,6cyclictest131rcu_preempt09:02:593
1708985992821,4cyclictest0-21swapper/209:30:262
1708985992820,4cyclictest0-21swapper/211:10:002
1708985992820,4cyclictest0-21swapper/210:25:152
1708985992818,6cyclictest1715877-21unixbench_multi07:25:242
1708982992810,11cyclictest131rcu_preempt09:00:111
1708979992822,4cyclictest1816600-21kworker/u8:1+events_unbound12:20:150
1708979992821,4cyclictest13550irq/42-30be0000.ethernet11:05:320
1708979992812,13cyclictest151rcuc/008:30:330
170899099279,11cyclictest131rcu_preempt09:10:303
170899099277,6cyclictest40-21ksoftirqd/308:45:023
1708990992718,7cyclictest391ktimers/311:50:143
170899099271,7cyclictest40-21ksoftirqd/312:20:133
1708990992712,4cyclictest131rcu_preempt11:02:143
170899099271,19cyclictest0-21swapper/307:46:473
1708985992719,5cyclictest1726966-21fschecks_count08:00:152
1708985992719,5cyclictest0-21swapper/209:00:242
170897999274,4cyclictest1759138-21cat09:30:250
170897999274,12cyclictest11-21ksoftirqd/011:26:280
1708979992720,4cyclictest1769157-21cut10:00:140
1708979992719,5cyclictest1712904-21kworker/u8:1+events_unbound07:35:150
1708979992718,7cyclictest1807276-21ntp_kernel_pll_11:50:190
170897999271,5cyclictest1732122-21apt-get08:15:140
170897999271,4cyclictest131rcu_preempt07:30:120
1708979992713,10cyclictest0-21swapper/009:25:000
1708979992712,5cyclictest1710234-21kworker/u8:2+events_unbound07:26:570
1708979992711,4cyclictest131rcu_preempt11:15:110
170899099263,5cyclictest381rcuc/310:45:203
170899099262,7cyclictest1776950-21cat10:20:263
1708990992619,4cyclictest1751094-21diskmemload09:10:013
1708990992616,7cyclictest391ktimers/308:10:133
170899099260,7cyclictest40-21ksoftirqd/308:50:253
1708985992620,4cyclictest1749110-21kworker/u8:1+events_unbound09:05:382
1708985992619,4cyclictest0-21swapper/211:10:252
1708985992616,6cyclictest0-21swapper/211:50:012
1708985992616,6cyclictest0-21swapper/207:35:082
1708985992615,6cyclictest0-21swapper/210:35:252
170897999269,6cyclictest1802903-21kworker/u8:2+events_unbound11:45:140
170897999267,16cyclictest0-21swapper/007:20:240
170897999262,3cyclictest131rcu_preempt09:40:010
170897999262,13cyclictest0-21swapper/009:55:200
1708979992620,4cyclictest1761465-21kworker/u8:2+events_unbound09:52:410
170897999261,4cyclictest131rcu_preempt10:40:120
170899099255,6cyclictest1717105-21grep07:30:203
170899099251,6cyclictest40-21ksoftirqd/311:25:243
1708985992517,4cyclictest0-21swapper/209:50:252
1708985992516,5cyclictest0-21swapper/210:00:012
1708985992516,4cyclictest0-21swapper/212:00:002
1708985992515,7cyclictest1737136-21latency_hist08:30:002
1708985992515,7cyclictest1737136-21latency_hist08:30:002
1708985992515,6cyclictest0-21swapper/212:20:182
1708985992514,6cyclictest0-21swapper/208:55:242
170897999257,3cyclictest131rcu_preempt11:35:010
1708979992518,5cyclictest1729938-21kworker/u8:2+events_unbound08:10:220
1708979992518,4cyclictest1804804-21cron11:45:000
1708979992516,6cyclictest1779636-21grep10:30:160
170897999251,5cyclictest1757719-21awk09:25:240
170897999251,14cyclictest0-21swapper/012:12:430
170899099244,5cyclictest40-21ksoftirqd/311:20:173
1708985992418,4cyclictest1761538-21cat09:40:012
1708985992416,6cyclictest1809757-21kworker/u8:4+events_unbound12:27:402
1708985992415,6cyclictest0-21swapper/210:55:152
1708985992415,6cyclictest0-21swapper/210:55:142
1708985992415,6cyclictest0-21swapper/208:55:012
1708985992415,5cyclictest0-21swapper/212:15:162
1708985992414,6cyclictest0-21swapper/210:05:252
170897999249,10cyclictest121ktimers/007:55:110
170897999247,8cyclictest131rcu_preempt11:00:170
1708979992418,4cyclictest1741096-21kworker/u8:3+events_unbound08:52:410
1708979992417,4cyclictest1794118-21grep11:10:250
1708979992416,6cyclictest1712904-21kworker/u8:1+events_unbound07:40:110
170897999241,3cyclictest131rcu_preempt09:40:250
170898599235,5cyclictest131rcu_preempt07:10:102
1708985992317,4cyclictest1749110-21kworker/u8:1+events_unbound09:15:392
1708985992317,3cyclictest0-21swapper/212:40:002
1708985992317,3cyclictest0-21swapper/208:05:242
1708979992314,6cyclictest11-21ksoftirqd/010:50:210
1708979992314,6cyclictest11-21ksoftirqd/010:50:200
1708979992313,6cyclictest0-21swapper/012:25:150
1708985992217,2cyclictest0-21swapper/207:20:152
1708985992216,3cyclictest0-21swapper/211:40:512
1708985992215,4cyclictest1813541-21sh12:10:002
1708985992212,6cyclictest0-21swapper/207:40:242
1708985992114,5cyclictest311ktimers/208:40:122
1708985992111,6cyclictest0-21swapper/208:35:162
170898599204,4cyclictest1809757-21kworker/u8:4+events_unbound12:11:072
170898599201,8cyclictest1822285-21munin-run12:35:002
170898599201,3cyclictest17966122awk11:20:132
1708985991910,6cyclictest0-21swapper/209:10:242
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional