You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-28 - 15:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Tue Oct 28, 2025 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
581982995114,7cyclictest0-21swapper/308:00:283
581982994922,4cyclictest0-21swapper/309:20:273
581978994835,9cyclictest311ktimers/207:30:162
581978994835,8cyclictest587587-21kworker/u8:0+events_unbound07:25:032
581982994739,4cyclictest661599-21cron11:00:003
581982994716,5cyclictest0-21swapper/307:55:273
581968994437,4cyclictest599771-21munin-plugin-st08:00:010
581978994315,7cyclictest131rcu_preempt09:15:122
581972994329,11cyclictest231ktimers/111:25:111
581978994231,5cyclictest0-21swapper/210:50:232
581968994134,4cyclictest654789-21munin-plugin-st10:40:010
581968994029,7cyclictest590634-21grep07:30:290
581978993932,5cyclictest580983-21kworker/u8:0+events_unbound07:15:032
581978993928,8cyclictest632190-21auditctl09:35:002
581978993928,8cyclictest632190-21auditctl09:35:002
581978993927,8cyclictest599782-21sendmail08:00:002
581972993832,3cyclictest0-21swapper/112:20:001
581972993832,3cyclictest0-21swapper/112:20:001
581968993828,7cyclictest629196-21fschecks_count09:25:190
581978993729,6cyclictest311ktimers/208:00:132
581978993729,4cyclictest0-21swapper/208:55:182
581978993726,5cyclictest0-21swapper/211:35:012
581982993629,3cyclictest0-21swapper/309:15:153
581978993628,4cyclictest0-21swapper/211:10:292
581968993629,4cyclictest652871-21audit_send_reply10:35:010
581968993629,4cyclictest608305-21cron08:25:000
581968993627,6cyclictest0-21swapper/008:45:260
581982993526,5cyclictest677169-21cron11:45:003
581982993526,5cyclictest653671-21kernelversion10:35:203
581982993526,4cyclictest0-21swapper/312:15:263
581982993526,4cyclictest0-21swapper/312:15:253
581982993521,8cyclictest0-21swapper/312:10:263
58197899352,4cyclictest0-21swapper/208:25:142
581968993524,6cyclictest0-21swapper/008:55:220
581978993425,5cyclictest0-21swapper/208:05:272
581978993424,5cyclictest0-21swapper/208:50:252
581972993427,3cyclictest678881-21kthreadd11:50:011
581968993424,6cyclictest0-21swapper/010:20:280
581968993420,12cyclictest11-21ksoftirqd/009:20:130
581982993324,6cyclictest620256-21sendmail09:00:013
581982993323,6cyclictest0-21swapper/308:40:013
581982993322,7cyclictest0-21swapper/312:00:263
581978993323,5cyclictest0-21swapper/208:15:012
581978993323,5cyclictest0-21swapper/208:15:012
58197899331,4cyclictest131rcu_preempt10:15:112
581972993325,4cyclictest0-21swapper/108:10:171
581972993325,4cyclictest0-21swapper/108:10:161
581972993324,6cyclictest634124-21sendmail09:40:001
581968993326,5cyclictest664859-21kworker/u8:0+events_unbound11:15:310
581968993325,4cyclictest0-21swapper/012:20:390
581968993323,6cyclictest0-21swapper/008:00:190
581982993224,4cyclictest0-21swapper/308:45:253
581982993221,7cyclictest673302-21grep11:30:283
581982993221,7cyclictest0-21swapper/310:35:013
581982993221,7cyclictest0-21swapper/307:35:283
58197899322,5cyclictest131rcu_preempt08:45:122
581978993224,4cyclictest0-21swapper/210:25:282
581978993223,5cyclictest694656-21munin-plugin-st12:35:002
581978993223,5cyclictest0-21swapper/209:50:012
581978993221,6cyclictest0-21swapper/211:20:262
581972993223,5cyclictest0-21swapper/109:20:261
581972993218,9cyclictest1-21systemd07:10:011
581968993224,4cyclictest0-21swapper/010:00:000
581968993215,15cyclictest11-21ksoftirqd/009:15:140
581982993119,7cyclictest0-21swapper/308:50:273
581978993123,4cyclictest0-21swapper/210:30:182
581978993116,11cyclictest215-21dbus-daemon09:40:192
581972993124,4cyclictest0-21swapper/111:00:281
581972993123,4cyclictest0-21swapper/110:05:211
581972993122,6cyclictest0-21swapper/112:15:011
581968993124,4cyclictest692941-21apt-key12:30:010
581968993121,6cyclictest0-21swapper/007:15:010
581982993023,3cyclictest0-21swapper/311:40:013
581982993018,7cyclictest0-21swapper/309:05:273
581982993018,6cyclictest0-21swapper/309:34:593
581982993018,6cyclictest0-21swapper/309:34:593
581978993023,3cyclictest0-21swapper/209:30:012
581978993020,5cyclictest0-21swapper/212:20:262
581978993018,8cyclictest680167-21grep11:50:272
581972993022,4cyclictest0-21swapper/110:35:221
581972993022,4cyclictest0-21swapper/109:55:281
581972993018,8cyclictest1-21systemd08:35:101
581972993018,7cyclictest0-21swapper/111:20:001
581968993023,3cyclictest0-21swapper/012:05:000
581968993021,6cyclictest0-21swapper/012:20:000
581968993021,6cyclictest0-21swapper/012:19:590
581968993019,6cyclictest0-21swapper/010:25:270
581968993016,10cyclictest121ktimers/011:20:130
581982992921,4cyclictest0-21swapper/309:55:273
581982992920,4cyclictest0-21swapper/309:50:203
581978992920,5cyclictest0-21swapper/211:59:592
581978992920,4cyclictest0-21swapper/212:20:002
581978992920,4cyclictest0-21swapper/212:19:592
581978992920,4cyclictest0-21swapper/210:20:292
581978992918,8cyclictest661619-21dpkg11:00:002
581972992922,4cyclictest590615-21unixbench_singl07:30:281
581972992921,4cyclictest0-21swapper/111:35:261
581972992921,4cyclictest0-21swapper/111:30:321
581972992921,4cyclictest0-21swapper/107:20:181
581972992921,4cyclictest0-21swapper/107:20:181
581972992919,7cyclictest592930-21latency_hist07:40:011
581972992917,9cyclictest0-21swapper/108:50:171
581968992921,4cyclictest0-21swapper/008:40:260
581968992921,4cyclictest0-21swapper/008:25:290
581968992920,6cyclictest0-21swapper/011:55:270
581982992819,6cyclictest0-21swapper/311:05:263
581982992819,6cyclictest0-21swapper/311:05:263
581982992818,6cyclictest609564-21unixbench_multi08:25:283
581978992820,4cyclictest0-21swapper/207:20:182
581978992820,4cyclictest0-21swapper/207:20:172
581972992822,3cyclictest0-21swapper/109:00:001
581972992821,4cyclictest646051-21munin-plugin-st10:15:001
581972992821,4cyclictest0-21swapper/111:55:271
581972992820,6cyclictest146-21jbd2/mmcblk1p2-807:45:231
581972992820,4cyclictest0-21swapper/110:45:261
581972992816,8cyclictest1-21systemd09:25:161
581968992820,4cyclictest0-21swapper/009:00:130
581982992719,4cyclictest0-21swapper/310:00:283
581982992717,6cyclictest0-21swapper/308:40:173
58197899272,21cyclictest686973-21grep12:10:272
581978992720,5cyclictest611954-21kworker/u8:2+events_unbound08:40:132
581978992720,4cyclictest621953-21sh09:05:012
581978992719,4cyclictest0-21swapper/209:10:272
581978992719,4cyclictest0-21swapper/207:40:282
581978992718,6cyclictest0-21swapper/212:40:002
581978992718,4cyclictest644348-21latency_hist10:10:002
581978992717,6cyclictest0-21swapper/210:35:262
581972992720,3cyclictest0-21swapper/107:40:281
581972992719,4cyclictest0-21swapper/109:40:201
581968992718,4cyclictest0-21swapper/010:00:200
581968992717,6cyclictest0-21swapper/011:45:260
581968992712,6cyclictest633937-21kworker/u8:2+events_unbound09:38:450
58198299266,3cyclictest6079282/usr/sbin/munin08:20:263
581982992618,5cyclictest655218-21cut10:40:173
581982992618,4cyclictest0-21swapper/312:05:273
581982992617,5cyclictest0-21swapper/308:35:003
581982992616,6cyclictest0-21swapper/309:00:193
581978992621,3cyclictest604749-21kworker/u8:0-events_power_efficient08:35:262
581978992616,7cyclictest642634-21cron10:05:012
581978992616,5cyclictest675453-21sh11:40:012
581972992619,4cyclictest669908-21grep11:20:261
581972992618,4cyclictest0-21swapper/108:05:171
581972992616,6cyclictest588915-21grep07:25:261
581972992616,6cyclictest0-21swapper/109:05:281
581968992620,4cyclictest646275-21kworker/u8:1-flush-179:9611:05:210
581968992620,4cyclictest646275-21kworker/u8:1-flush-179:9611:05:210
581968992620,4cyclictest602002-21if_err_eth108:05:190
581968992619,4cyclictest0-21swapper/009:50:270
581968992618,5cyclictest0-21swapper/007:40:010
581968992617,6cyclictest0-21swapper/009:34:590
581968992617,6cyclictest0-21swapper/009:34:590
581968992617,6cyclictest0-21swapper/007:20:000
581968992616,6cyclictest0-21swapper/011:35:170
581968992616,6cyclictest0-21swapper/011:10:280
581982992519,3cyclictest0-21swapper/311:55:173
581982992518,3cyclictest0-21swapper/308:10:013
581982992517,4cyclictest0-21swapper/310:25:273
581982992516,4cyclictest0-21swapper/312:25:273
581982992514,6cyclictest0-21swapper/309:40:263
581978992517,5cyclictest628781-21cron09:25:002
581978992517,5cyclictest0-21swapper/209:55:292
581978992517,4cyclictest0-21swapper/212:25:182
581978992517,4cyclictest0-21swapper/211:45:012
581978992516,4cyclictest0-21swapper/211:05:002
58197299252,20cyclictest656080-21grep10:40:261
581972992519,3cyclictest0-21swapper/109:00:161
581972992519,3cyclictest0-21swapper/107:15:231
581972992518,5cyclictest599618-21kworker/u8:0+events_unbound08:01:071
581972992517,5cyclictest0-21swapper/112:40:001
581972992516,6cyclictest0-21swapper/112:30:151
58196899256,5cyclictest659256-21cat10:50:240
581968992519,3cyclictest0-21swapper/010:05:210
581968992514,7cyclictest4029188-1kworker/0:0H+mmc_complete08:20:010
58198299249,10cyclictest215-21dbus-daemon07:20:023
58198299249,10cyclictest215-21dbus-daemon07:20:023
581982992418,3cyclictest696353-21sendmail12:39:593
581982992417,4cyclictest669613-21mailstats11:20:253
581982992417,3cyclictest0-21swapper/309:10:233
581982992416,4cyclictest0-21swapper/307:25:263
581982992415,5cyclictest0-21swapper/307:50:163
581982992414,6cyclictest0-21swapper/311:25:163
581982992414,6cyclictest0-21swapper/307:30:293
581982992414,6cyclictest0-21swapper/307:15:273
581982992413,7cyclictest0-21swapper/310:15:203
581982992413,6cyclictest0-21swapper/311:50:273
581982992413,6cyclictest0-21swapper/311:00:283
581982992413,6cyclictest0-21swapper/307:40:283
581978992418,4cyclictest580983-21kworker/u8:0+events_unbound07:13:442
581978992418,3cyclictest0-21swapper/207:45:172
581978992416,6cyclictest618497-21kworker/u8:0+events_unbound09:05:292
581978992416,5cyclictest678265-21sort11:45:262
581972992418,4cyclictest646273-21/usr/sbin/munin10:15:211
581972992417,5cyclictest231ktimers/111:05:171
581972992417,5cyclictest231ktimers/111:05:171
581972992417,3cyclictest0-21swapper/110:50:161
581972992415,6cyclictest642188-21unixbench_multi10:00:291
581972992414,6cyclictest0-21swapper/110:30:231
581972992413,8cyclictest596826-21cut07:50:171
581972992412,9cyclictest692142-21wc12:25:251
581968992418,3cyclictest0-21swapper/010:10:330
581968992418,3cyclictest0-21swapper/009:50:020
581968992417,5cyclictest11-21ksoftirqd/012:30:120
581968992415,6cyclictest0-21swapper/007:45:260
58196899241,4cyclictest589334-21munin-run07:30:010
581968992414,6cyclictest0-21swapper/009:05:270
581982992316,4cyclictest0-21swapper/311:15:163
581982992315,5cyclictest0-21swapper/309:35:053
581982992315,4cyclictest665623-21fschecks_count11:10:173
581978992317,3cyclictest0-21swapper/209:50:282
581978992313,6cyclictest664398-21cut11:05:242
581978992313,6cyclictest664398-21cut11:05:232
581978992311,7cyclictest606148-21grep08:15:252
581978992310,3cyclictest131rcu_preempt10:40:132
581972992319,2cyclictest0-21swapper/108:30:131
581972992317,3cyclictest0-21swapper/109:15:331
581972992314,5cyclictest651160-21cron10:30:011
581972992312,7cyclictest215-21dbus-daemon09:10:151
581968992317,4cyclictest0-21swapper/008:12:480
581968992317,4cyclictest0-21swapper/008:12:480
581968992316,4cyclictest0-21swapper/012:05:270
581968992315,5cyclictest0-21swapper/011:40:240
581968992315,5cyclictest0-21swapper/011:25:180
581968992313,7cyclictest0-21swapper/009:40:260
58196899231,2cyclictest679111-21apt-get11:50:150
58196899231,18cyclictest0-21swapper/010:45:330
58196899231,18cyclictest0-21swapper/008:51:370
58196899231,18cyclictest0-21swapper/008:40:000
58196899231,18cyclictest0-21swapper/007:41:490
58196899231,18cyclictest0-21swapper/007:22:010
58196899231,18cyclictest0-21swapper/007:22:000
581982992217,3cyclictest599-21sshd08:10:023
581982992217,3cyclictest599-21sshd08:10:013
581982992216,3cyclictest0-21swapper/312:30:203
581982992215,3cyclictest0-21swapper/312:20:183
581982992215,3cyclictest0-21swapper/310:50:013
581982992215,3cyclictest0-21swapper/309:25:233
581982992214,5cyclictest0-21swapper/310:25:003
581982992214,3cyclictest0-21swapper/310:50:153
581982992212,6cyclictest583889-21date07:15:023
581978992215,4cyclictest670723-21fschecks_count11:25:152
581978992215,3cyclictest0-21swapper/209:35:152
581978992214,5cyclictest685382-21kworker/u8:2+events_unbound12:09:332
581978992213,6cyclictest646053-21basename10:15:002
581978992213,5cyclictest0-21swapper/211:15:172
581978992213,5cyclictest0-21swapper/208:20:162
581972992216,3cyclictest0-21swapper/108:15:191
581972992215,4cyclictest0-21swapper/112:05:261
581972992214,5cyclictest0-21swapper/112:00:111
581972992214,5cyclictest0-21swapper/111:10:211
581972992214,4cyclictest0-21swapper/111:40:261
581972992214,4cyclictest0-21swapper/108:45:261
58197299221,3cyclictest131rcu_preempt11:50:191
581972992213,6cyclictest0-21swapper/108:45:011
581968992216,3cyclictest0-21swapper/011:30:270
58196899221,19cyclictest0-21swapper/011:03:020
58196899221,19cyclictest0-21swapper/010:55:230
58196899221,19cyclictest0-21swapper/009:13:210
581968992210,8cyclictest1-21systemd10:15:230
58196899220,18cyclictest0-21swapper/008:33:350
581982992115,3cyclictest0-21swapper/308:15:173
581982992114,3cyclictest0-21swapper/311:45:243
581982992112,5cyclictest0-21swapper/309:45:173
581982992110,8cyclictest594900-21apt-get07:45:123
581978992114,5cyclictest646275-21kworker/u8:1+events_unbound10:50:012
581978992114,5cyclictest311ktimers/212:00:212
581972992114,3cyclictest0-21swapper/109:30:201
581972992114,3cyclictest0-21swapper/109:30:201
581972992114,3cyclictest0-21swapper/108:25:231
581972992113,6cyclictest0-21swapper/109:45:211
581972992113,5cyclictest0-21swapper/112:20:161
581972992112,6cyclictest599122-21sed07:55:271
58196899210,19cyclictest0-21swapper/012:10:400
58196899210,19cyclictest0-21swapper/007:50:080
581978992014,4cyclictest592647-21kworker/u8:1+events_unbound07:50:492
58197299209,7cyclictest215-21dbus-daemon10:55:301
581972992014,3cyclictest0-21swapper/110:20:371
58196899201,4cyclictest655034-21apt-get10:40:130
58198299199,7cyclictest643734-21/usr/sbin/munin10:05:303
581982991914,3cyclictest645350-21sensors_temp10:10:313
581978991913,4cyclictest311ktimers/208:30:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional