You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-22 - 20:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Tue Apr 22, 2025 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3498384995517,20cyclictest0-21swapper/308:55:263
3498370995546,5cyclictest3526507-21munin-plugin-st08:30:010
3498384995443,7cyclictest3529489-21grep08:35:283
3498375995240,8cyclictest231ktimers/111:10:081
349838499481,38cyclictest0-21swapper/311:20:113
349838499470,39cyclictest0-21swapper/309:40:143
349838499470,39cyclictest0-21swapper/309:40:133
349838499463,25cyclictest3571043-21cat10:50:213
3498375994637,5cyclictest3584858-21idleruntime-cro11:40:001
349838499452,37cyclictest3508051-21apt-get07:35:143
349838499451,39cyclictest3522152-21/usr/sbin/munin08:15:203
349838499441,40cyclictest3576290-21/usr/sbin/munin11:10:153
349838499441,40cyclictest3562500-21/usr/sbin/munin10:20:243
349838499441,40cyclictest3562500-21/usr/sbin/munin10:20:243
349838499441,39cyclictest3514845-21apt-get07:55:153
349838499441,38cyclictest3587750-21/usr/sbin/munin11:50:133
349838499441,38cyclictest3511462-21/usr/sbin/munin07:45:143
349838499432,36cyclictest3504572-21/usr/sbin/munin07:25:183
349838499432,35cyclictest3555918-21df10:00:143
349838499431,37cyclictest3581682-21apt-get11:30:093
349838499431,37cyclictest3518179-21latency_hist08:05:013
349838499422,36cyclictest3595173-21/usr/sbin/munin12:15:153
349838499421,38cyclictest3574080-21/usr/sbin/munin11:00:193
349838499421,38cyclictest3513336-21/usr/sbin/munin07:50:213
349838499421,38cyclictest3513336-21/usr/sbin/munin07:50:213
349838499421,36cyclictest3577991-21/usr/sbin/munin11:15:213
349838499421,36cyclictest3544274-21/usr/sbin/munin09:20:183
349838499421,35cyclictest3525735-21/usr/sbin/munin08:25:253
3498375994235,4cyclictest3561505-21munin-plugin-st10:20:001
3498375994235,4cyclictest3561505-21munin-plugin-st10:19:591
3498375994230,7cyclictest3505458-21grep07:25:291
3498370994235,4cyclictest3602061-21idleruntime-cro12:40:010
3498370994235,4cyclictest3553911-21latency_hist09:55:010
3498384994129,8cyclictest3602027-21apt-get12:40:013
349838499412,34cyclictest3583467-21/usr/sbin/munin11:35:133
349838499411,37cyclictest3596998-21/usr/sbin/munin12:20:213
349838499411,37cyclictest3540870-21/usr/sbin/munin09:10:213
349838499411,37cyclictest3532737-21/usr/sbin/munin08:45:263
349838499411,37cyclictest0-21swapper/310:35:123
349838499411,36cyclictest3546464-21apt-get09:30:093
349838499411,35cyclictest3591257-21/usr/sbin/munin12:00:183
349838499411,35cyclictest3533603-21/usr/sbin/munin08:50:173
349838499411,35cyclictest3523652-21/usr/sbin/munin08:20:193
349838499411,34cyclictest3542222-21apt-get09:15:143
349838499411,34cyclictest3526734-21apt-get08:30:173
3498370994130,7cyclictest0-21swapper/007:50:320
3498370994130,7cyclictest0-21swapper/007:50:310
349838499402,32cyclictest3538620-21apt-get09:05:143
349838499401,36cyclictest3585538-21/usr/sbin/munin11:40:193
349838499401,35cyclictest3560407-21/usr/sbin/munin10:15:183
349838499401,35cyclictest3560407-21/usr/sbin/munin10:15:183
349838499401,35cyclictest3509763-21apt-get07:40:143
349838499401,34cyclictest3598266-21sshd12:25:333
349838499401,34cyclictest3575593-21sshd11:08:323
349838499401,34cyclictest3551671-21sshd09:46:323
349838499401,34cyclictest3537529-21/usr/sbin/munin09:00:233
349838499401,32cyclictest3552197-21apt-get09:50:143
3498384994011,26cyclictest3572340-21sed10:55:193
349838499400,37cyclictest3506637-21/usr/sbin/munin07:30:223
349838499393,33cyclictest3559414-21users10:10:223
349838499392,34cyclictest3600122-21sshd12:32:323
349838499391,35cyclictest3549003-21/usr/sbin/munin09:35:243
349838499391,35cyclictest3501485-21/usr/sbin/munin07:15:213
349838499391,35cyclictest3498771-21fw_packets07:10:173
349838499391,33cyclictest3564281-21apt-get10:30:073
349838499391,33cyclictest3557690-21sshd10:07:313
349838499391,33cyclictest3530408-21if_err_eth108:40:153
3498379993931,4cyclictest0-21swapper/211:50:122
3498370993933,3cyclictest0-21swapper/008:10:010
349838499382,30cyclictest3519942-21apt-get08:10:163
349838499381,34cyclictest3554421-21if_eth109:55:183
349838499381,33cyclictest3593699-21/usr/sbin/munin12:10:173
349838499381,33cyclictest3569867-21sshd10:48:323
349838499381,33cyclictest3569867-21sshd10:48:313
349838499381,32cyclictest3502874-21df_inode07:20:173
349838499381,31cyclictest3589204-21/usr/sbin/munin11:55:133
3498375993828,7cyclictest3592906-21cron12:10:001
3498375993828,7cyclictest3592906-21cron12:09:591
3498375993821,13cyclictest231ktimers/112:20:141
349838499371,33cyclictest3563212-21apt-get10:25:043
349838499371,32cyclictest3581199-21cron11:26:593
349838499371,31cyclictest3568017-21df_inode10:40:163
3498379993727,6cyclictest3510781-21grep07:40:272
3498375993727,6cyclictest3595897-21grep12:15:231
3498375993725,7cyclictest3600330-21sh12:35:001
3498370993727,6cyclictest0-21swapper/012:35:010
349838499361,32cyclictest3592617-21sshd12:06:333
349838499361,32cyclictest3592617-21sshd12:06:333
349838499361,32cyclictest3587137-21sshd11:49:333
349838499361,32cyclictest3518695-21meminfo08:05:223
3498379993629,4cyclictest3602064-21kworker/u8:112:40:012
3498379993628,4cyclictest0-21swapper/211:25:012
3498375993628,5cyclictest3562812-21unixbench_singl10:20:251
3498375993628,5cyclictest3562812-21unixbench_singl10:20:251
3498375993626,6cyclictest0-21swapper/108:55:251
3498379993528,4cyclictest0-21swapper/212:00:002
3498379993527,4cyclictest0-21swapper/208:40:252
3498379993524,7cyclictest3586075-21grep11:40:252
3498375993525,6cyclictest0-21swapper/107:25:011
3498370993528,4cyclictest3546029-21latency_hist09:30:010
3498370993525,7cyclictest3550051-21tune2fs09:40:170
3498370993525,7cyclictest3550051-21tune2fs09:40:170
3498370993525,6cyclictest3582711-21grep11:30:220
3498384993415,16cyclictest0-21swapper/309:30:013
3498379993420,6cyclictest131rcu_preempt11:14:202
3498375993425,4cyclictest0-21swapper/109:05:271
3498375993424,6cyclictest0-21swapper/108:15:011
3498375993423,7cyclictest3588411-21grep11:50:211
3498375993422,8cyclictest3590561-21cron12:00:001
3498370993427,4cyclictest3505460-21unixbench_multi07:25:290
3498370993424,5cyclictest0-21swapper/012:25:000
3498379993326,3cyclictest0-21swapper/208:20:012
3498379993324,5cyclictest0-21swapper/212:30:012
3498375993326,3cyclictest0-21swapper/107:15:011
3498375993325,5cyclictest0-21swapper/107:35:281
3498375993325,4cyclictest0-21swapper/112:00:161
3498375993325,4cyclictest0-21swapper/110:00:261
3498375993324,5cyclictest3511670-21fschecks_time07:45:171
3498375993323,6cyclictest3574628-21grep11:00:251
3498375993323,6cyclictest0-21swapper/107:55:001
3498375993323,6cyclictest0-21swapper/107:55:001
3498370993327,3cyclictest0-21swapper/012:15:230
3498370993321,6cyclictest0-21swapper/007:15:280
349837999327,7cyclictest32-21ksoftirqd/209:10:292
349837999325,6cyclictest32-21ksoftirqd/207:50:192
349837999325,6cyclictest32-21ksoftirqd/207:50:192
3498379993221,7cyclictest3562755-21grep10:20:252
3498379993221,7cyclictest3562755-21grep10:20:252
3498379993221,4cyclictest131rcu_preempt10:51:042
3498379993213,10cyclictest131rcu_preempt10:33:272
3498375993224,4cyclictest0-21swapper/108:40:151
3498375993221,7cyclictest3580358-21grep11:20:261
3498370993223,4cyclictest0-21swapper/012:00:000
3498370993220,7cyclictest3532824-21grep08:45:260
349837999318,5cyclictest32-21ksoftirqd/212:05:002
349837999315,6cyclictest32-21ksoftirqd/207:55:282
349837999314,5cyclictest32-21ksoftirqd/212:25:002
3498379993123,4cyclictest0-21swapper/208:55:262
3498379993122,6cyclictest3557279-21munin-plugin-st10:05:012
3498375993123,5cyclictest0-21swapper/109:54:591
3498375993119,8cyclictest3502064-21grep07:15:271
3498375993118,9cyclictest3573392-21run-parts11:00:001
3498370993121,7cyclictest3549646-21sendmail09:39:590
3498370993120,7cyclictest3569373-21idleruntime-cro10:45:000
349837099311,9cyclictest3499997-21apt-get07:15:010
349837999307,6cyclictest32-21ksoftirqd/211:05:012
349837999306,5cyclictest32-21ksoftirqd/209:20:332
3498379993023,4cyclictest311ktimers/207:10:232
3498379993022,3cyclictest0-21swapper/211:20:012
3498379993021,6cyclictest3546622-21fschecks_count09:30:122
3498379993019,7cyclictest0-21swapper/212:10:222
3498379993010,12cyclictest0-21swapper/207:45:152
3498375993021,6cyclictest0-21swapper/108:50:011
3498375993019,7cyclictest0-21swapper/111:30:221
3498370993023,4cyclictest0-21swapper/008:55:260
3498370993023,4cyclictest0-21swapper/008:20:000
3498370993022,5cyclictest3574630-21unixbench_multi11:00:250
3498370993021,6cyclictest3580418-21grep11:20:250
3498370993020,7cyclictest3538797-21tune2fs09:05:160
3498370993020,6cyclictest0-21swapper/010:15:250
3498370993020,6cyclictest0-21swapper/010:15:250
3498370993020,6cyclictest0-21swapper/010:05:000
3498370993019,7cyclictest3521395-21sh08:15:010
349837099301,18cyclictest0-21swapper/010:15:000
349837999294,5cyclictest32-21ksoftirqd/209:55:262
3498379992924,3cyclictest301rcuc/210:47:282
3498379992924,3cyclictest301rcuc/210:47:282
3498379992922,4cyclictest0-21swapper/207:20:272
3498379992922,3cyclictest0-21swapper/212:15:232
3498379992921,4cyclictest0-21swapper/208:55:002
3498379992920,7cyclictest311ktimers/209:50:212
3498379992919,7cyclictest3540083-21idleruntime-cro09:10:002
3498379992919,7cyclictest311ktimers/210:35:562
3498379992918,4cyclictest131rcu_preempt12:07:412
3498379992918,4cyclictest131rcu_preempt12:07:412
3498379992914,4cyclictest131rcu_preempt08:25:002
3498379992912,4cyclictest0-21swapper/207:27:202
3498379992910,3cyclictest0-21swapper/208:46:332
3498370992919,6cyclictest0-21swapper/010:40:000
349837999288,6cyclictest32-21ksoftirqd/212:30:102
349837999284,7cyclictest32-21ksoftirqd/211:10:012
3498379992821,3cyclictest0-21swapper/210:55:252
3498379992821,3cyclictest0-21swapper/208:00:332
3498379992820,5cyclictest0-21swapper/209:49:592
3498379992818,6cyclictest0-21swapper/211:35:242
3498379992814,8cyclictest131rcu_preempt10:41:182
3498379992811,10cyclictest131rcu_preempt07:35:132
349837999280,9cyclictest3564149-21cut10:30:012
3498375992821,3cyclictest0-21swapper/109:30:121
3498375992820,5cyclictest0-21swapper/110:40:171
3498375992820,5cyclictest0-21swapper/108:35:281
3498375992817,7cyclictest3557913-21basename10:10:011
3498375992817,7cyclictest3517278-21seq08:00:321
3498375992817,6cyclictest0-21swapper/109:10:311
3498370992821,4cyclictest13650irq/42-30be0000.ethernet10:35:010
3498370992820,5cyclictest199-21systemd-network10:55:190
3498370992818,6cyclictest0-21swapper/009:15:260
349837999277,5cyclictest32-21ksoftirqd/208:15:012
349837999273,7cyclictest3548906-21grep09:35:242
3498379992720,4cyclictest0-21swapper/207:15:282
3498379992720,3cyclictest0-21swapper/209:00:262
3498379992719,4cyclictest0-21swapper/208:35:282
3498379992717,7cyclictest311ktimers/211:30:142
3498379992717,7cyclictest311ktimers/208:31:542
3498379992717,6cyclictest0-21swapper/210:10:112
349837999271,18cyclictest0-21swapper/210:15:252
349837999271,18cyclictest0-21swapper/210:15:242
3498375992719,4cyclictest0-21swapper/108:05:271
349837599271,23cyclictest3543066-21wc09:15:251
3498370992723,2cyclictest13650irq/42-30be0000.ethernet09:55:220
3498370992717,6cyclictest3544997-21unixbench_singl09:20:330
3498370992717,6cyclictest3509673-21grep07:40:010
349837999265,5cyclictest32-21ksoftirqd/210:10:012
349837999264,5cyclictest32-21ksoftirqd/207:30:282
3498379992618,4cyclictest0-21swapper/208:25:272
3498375992619,5cyclictest3602033-21munin-run12:40:011
3498375992616,7cyclictest3586037-21ls11:40:241
3498370992619,4cyclictest13650irq/42-30be0000.ethernet07:25:000
3498370992618,4cyclictest0-21swapper/009:10:200
349837999256,4cyclictest311ktimers/209:18:172
349837999254,7cyclictest32-21ksoftirqd/208:05:182
349837999253,6cyclictest32-21ksoftirqd/211:27:222
3498379992516,7cyclictest311ktimers/209:40:182
3498379992516,7cyclictest311ktimers/209:40:172
3498375992516,6cyclictest231ktimers/110:50:111
3498375992515,7cyclictest3558644-21cat10:10:131
349837099252,5cyclictest3524359-21tail08:20:280
349837099252,4cyclictest3516307-21munin-run08:00:000
3498370992518,5cyclictest165-21systemd-journal08:31:420
3498370992518,4cyclictest0-21swapper/010:50:230
349837099251,5cyclictest3561856-21df10:20:140
349837099251,5cyclictest3561856-21df10:20:130
3498370992515,6cyclictest3529426-21grep08:35:280
3498379992415,7cyclictest311ktimers/209:26:012
3498379992415,6cyclictest311ktimers/211:47:512
3498375992417,3cyclictest0-21swapper/109:20:161
3498375992416,4cyclictest0-21swapper/108:30:201
3498375992415,6cyclictest0-21swapper/109:30:001
3498375992413,8cyclictest3516218-21seq07:59:031
3498370992418,3cyclictest13950irq/36-mmc108:45:000
3498370992418,3cyclictest0-21swapper/012:10:120
3498370992417,5cyclictest165-21systemd-journal12:25:410
3498370992417,3cyclictest0-21swapper/011:41:370
3498370992417,3cyclictest0-21swapper/011:15:270
3498370992416,4cyclictest0-21swapper/009:30:120
349837099241,19cyclictest0-21swapper/012:05:100
349837099241,19cyclictest0-21swapper/012:05:100
349837099240,20cyclictest0-21swapper/011:39:130
3498375992317,3cyclictest0-21swapper/108:15:181
3498375992316,3cyclictest0-21swapper/109:40:171
3498375992316,3cyclictest0-21swapper/109:40:171
3498375992316,3cyclictest0-21swapper/109:00:141
3498375992314,6cyclictest3575617-21seq11:08:491
3498375992314,6cyclictest3569701-21seq10:46:321
3498375992314,6cyclictest3569701-21seq10:46:321
3498375992314,6cyclictest3565367-21seq10:30:291
3498375992313,8cyclictest3598588-21seq12:29:291
3498375992313,7cyclictest3563706-21seq10:25:511
349837099231,8cyclictest3557914-21idleruntime-cro10:10:010
3498370992316,3cyclictest0-21swapper/009:00:260
3498370992316,3cyclictest0-21swapper/007:49:350
349837099231,3cyclictest3506361-21apt-get07:30:160
349837099231,20cyclictest0-21swapper/008:52:400
349837099231,20cyclictest0-21swapper/007:40:190
349837099231,18cyclictest0-21swapper/011:11:090
349837099230,19cyclictest0-21swapper/010:49:560
349837099230,19cyclictest0-21swapper/010:49:560
3498375992216,3cyclictest0-21swapper/109:35:251
3498375992216,3cyclictest0-21swapper/107:30:281
3498375992215,5cyclictest299-21systemd-logind11:25:411
3498375992215,4cyclictest3579106-21cron11:20:011
3498375992214,6cyclictest231ktimers/110:35:031
3498375992213,6cyclictest0-21swapper/107:45:001
3498375992212,7cyclictest3526553-21cut08:30:011
3498375992211,8cyclictest3524684-21seq08:23:381
3498370992215,5cyclictest121ktimers/008:00:130
3498370992215,3cyclictest0-21swapper/011:06:290
3498370992215,3cyclictest0-21swapper/010:27:160
349837099221,19cyclictest0-21swapper/012:00:140
349837099221,19cyclictest0-21swapper/011:28:470
3498370992211,8cyclictest3587407-21apt11:50:060
3498375992115,4cyclictest231ktimers/112:10:101
3498375992113,5cyclictest231ktimers/109:55:231
3498375992111,7cyclictest3551900-21seq09:49:191
3498375992010,7cyclictest3535102-21cat08:55:011
349837099200,3cyclictest0-21swapper/009:46:420
349837099200,16cyclictest0-21swapper/011:46:090
349837599190,12cyclictest0-21swapper/111:47:351
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional