You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-01-18 - 14:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Sat Jan 18, 2025 12:42:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24906099533,36cyclictest301457-21ssh09:36:252
249060995243,6cyclictest956-21mta-sts-daemon07:11:242
249060994942,4cyclictest273075-21kworker/u8:4-xprtiod09:00:012
249060994942,4cyclictest273075-21kworker/u8:4-xprtiod09:00:012
249060994938,7cyclictest378143-21unin-run11:25:012
249059994835,9cyclictest422-21dbus-daemon09:35:011
249060994741,3cyclictest0-21swapper/211:31:242
249058994739,6cyclictest422-21dbus-daemon09:05:010
249058994739,6cyclictest422-21dbus-daemon09:05:010
249060994537,5cyclictest433567-21munin-run12:40:012
249060994535,6cyclictest0-21swapper/209:55:012
249060994535,5cyclictest0-21swapper/210:11:192
249060994534,5cyclictest0-21swapper/210:21:242
249059994536,6cyclictest453-21systemd-logind08:15:021
249059994437,3cyclictest0-21swapper/111:31:231
249058994429,9cyclictest12450irq/32-eth009:41:240
24905899440,41cyclictest367615-21ssh11:11:200
249060994335,5cyclictest283813-21latency_hist09:10:012
249060994334,5cyclictest386875-21mailstats11:36:342
249060994328,9cyclictest0-21swapper/212:31:182
249060994328,9cyclictest0-21swapper/212:31:182
249060994234,5cyclictest425652-21latency_hist12:30:022
249060994233,6cyclictest268566-21systemd-run08:15:012
249060994233,6cyclictest266-21systemd-journal11:16:112
249060994233,6cyclictest261070-21systemd-run07:50:022
249060994232,6cyclictest370031-21cron11:15:012
249058994235,5cyclictest412560-21mailstats12:11:310
249058994235,4cyclictest312664-21cron09:55:010
249060994131,5cyclictest0-21swapper/207:20:012
249059994132,6cyclictest474-21in:imuxsock07:40:021
249059994032,5cyclictest418782-21sendmail12:20:011
249059994032,5cyclictest0-21swapper/110:40:011
249059994028,8cyclictest412600-21mailstats12:11:321
24905999402,32cyclictest360906-21ssh11:01:281
249058994025,13cyclictest258285-40mandb07:40:510
249059993934,3cyclictest374087-21plymouth11:20:011
249059993930,6cyclictest3645540-21cups-browsed10:49:201
249059993930,6cyclictest303426-21latency_hist09:40:021
249060993829,6cyclictest393070-21true11:45:022
249060993829,6cyclictest393070-21true11:45:022
249060993828,4cyclictest0-21swapper/207:51:252
249059993830,5cyclictest291877-21fschecks_time09:21:151
249060993730,4cyclictest290893-21cron09:20:012
24905999374,25cyclictest375793-21ssh11:21:301
249059993732,2cyclictest0-21swapper/108:25:021
249059993729,5cyclictest381025-21latency_hist11:30:021
249059993729,5cyclictest322535-21systemd-run10:10:021
249059993729,5cyclictest322535-21systemd-run10:10:021
249059993726,8cyclictest275355-21needreboot08:36:191
249058993730,4cyclictest3645540-21cups-browsed09:26:430
24906099363,25cyclictest292398-21ssh09:21:262
249060993629,3cyclictest0-21swapper/212:00:012
249060993626,6cyclictest309025-21systemd-run09:50:012
249059993629,3cyclictest0-21swapper/111:45:021
249059993629,3cyclictest0-21swapper/111:45:021
249059993628,5cyclictest318203-21unixbench_multi10:01:311
249059993627,6cyclictest491-21gdbus12:36:301
24905899364,25cyclictest431086-21ssh12:36:220
249058993629,4cyclictest403880-21cron12:00:010
249058993629,4cyclictest391171-21grep11:41:340
249058993629,4cyclictest391171-21grep11:41:340
249058993627,7cyclictest289757-21sshd09:17:110
249058993623,3cyclictest0-21swapper/010:56:110
249058993623,3cyclictest0-21swapper/010:56:110
249060993529,3cyclictest0-21swapper/211:00:012
249060993529,3cyclictest0-21swapper/211:00:012
249060993528,4cyclictest395867-21kworker/u8:7-xprtiod12:22:112
249060993528,4cyclictest287391-21munin-plugin-st09:15:012
249060993526,5cyclictest299907-21systemd-run09:35:012
249060993525,8cyclictest957-21mta-sts-daemon10:05:582
249060993525,8cyclictest957-21mta-sts-daemon10:05:582
249060993525,6cyclictest355236-21latency_hist10:55:022
24905999356,19cyclictest437-21mta-sts-daemon09:56:241
249059993527,3cyclictest0-21swapper/111:51:181
249059993525,7cyclictest265546-21cron08:05:011
24905899353,24cyclictest371787-21ssh11:16:330
249058993530,3cyclictest280562-21kworker/u8:7-xprtiod09:10:010
249058993521,9cyclictest12450irq/32-eth009:11:200
249060993424,6cyclictest304371-21needreboot09:41:182
249060993423,8cyclictest422-21dbus-daemon10:50:022
24906099341,25cyclictest338531-21ssh10:31:232
249059993427,3cyclictest0-21swapper/110:21:231
249059993426,5cyclictest336911-21cron10:30:011
249059993426,5cyclictest309015-21idleruntime-cro09:50:011
249059993426,5cyclictest249069-21systemd-run07:10:011
249059993426,4cyclictest0-21swapper/109:55:011
249059993425,6cyclictest0-21swapper/111:40:011
249059993424,7cyclictest366190-21latency_hist11:10:021
249059993424,7cyclictest3645540-21cups-browsed12:29:281
249059993422,9cyclictest405905-21switchtime12:01:351
249059993421,9cyclictest427484-21timerandwakeup12:31:301
249059993421,9cyclictest427484-21timerandwakeup12:31:301
249058993429,3cyclictest151ktimers/008:06:210
249058993428,4cyclictest418784-21munin-plugin-st12:20:010
249058993427,4cyclictest336915-21cron10:30:010
249058993427,4cyclictest275537-21/usr/sbin/munin08:36:280
249060993327,3cyclictest252082-21kworker/u8:10-nfsiod07:40:482
249060993326,4cyclictest955-21mta-sts-daemon12:11:292
249060993326,3cyclictest0-21swapper/211:05:022
249060993325,5cyclictest0-21swapper/210:05:022
249060993323,7cyclictest3645540-21cups-browsed11:06:142
249060993316,12cyclictest351ktimers/208:06:272
24905999336,18cyclictest437-21mta-sts-daemon07:21:311
249059993326,3cyclictest0-21swapper/111:56:261
249059993324,4cyclictest299919-21kworker/u8:14-rpciod10:30:261
24905999331,27cyclictest367509-21ssh11:11:151
249058993327,4cyclictest956-21mta-sts-daemon07:21:370
249058993327,4cyclictest381000-21latency_hist11:30:020
249058993326,5cyclictest421-21avahi-daemon09:35:080
249058993326,4cyclictest395826-21cron11:50:010
249058993326,4cyclictest345817-21cut10:41:140
249058993326,3cyclictest0-21swapper/012:01:290
249058993325,5cyclictest421-21avahi-daemon09:59:370
249058993323,7cyclictest265572-21systemd-run08:05:010
249058993323,2cyclictest0-21swapper/010:21:280
249058993321,10cyclictest3645540-21cups-browsed10:32:280
249060993224,5cyclictest433-21polkitd12:06:592
249060993222,8cyclictest274297-21timerandwakeup08:31:382
249060993222,5cyclictest0-21swapper/209:56:202
249060993221,3cyclictest171rcu_preempt09:01:222
249060993221,3cyclictest171rcu_preempt09:01:222
24906099321,23cyclictest416339-21ssh12:16:232
24905999323,23cyclictest285486-21ssh09:11:251
249059993226,3cyclictest0-21swapper/110:56:271
249059993226,3cyclictest0-21swapper/110:56:271
249059993226,3cyclictest0-21swapper/108:45:011
249059993226,3cyclictest0-21swapper/107:20:011
249059993225,4cyclictest3645540-21cups-browsed08:26:341
249059993225,4cyclictest254984-21unixbench_singl07:26:321
249059993225,4cyclictest254984-21unixbench_singl07:26:321
249059993224,5cyclictest324395-21threads10:11:271
249059993223,6cyclictest421-21avahi-daemon09:10:001
249059993222,5cyclictest0-21swapper/110:51:221
24905899323,24cyclictest342362-21ssh10:36:200
249058993226,4cyclictest0-21swapper/011:55:020
249058993226,2cyclictest0-21swapper/012:21:410
249060993121,7cyclictest0-21swapper/210:30:012
249060993119,9cyclictest296600-21latency_hist09:30:032
24905999314,21cyclictest327927-21ssh10:16:271
249059993124,5cyclictest249057-21cyclictest11:48:491
249059993123,4cyclictest0-21swapper/112:21:331
24905999312,21cyclictest304428-21ssh09:41:201
249059993121,7cyclictest258911-21ntp_kernel_err07:41:211
249058993123,6cyclictest386308-21kernelversion11:36:210
249058993123,4cyclictest433-21polkitd10:19:040
249058993120,8cyclictest421-21avahi-daemon11:09:220
24905899311,23cyclictest360728-21ssh11:01:220
249058993111,15cyclictest375777-21ssh11:21:300
249060993022,4cyclictest0-21swapper/210:36:112
249060993020,8cyclictest257288-21missed_timers07:36:472
249060993020,7cyclictest1-21systemd10:15:112
249059993023,4cyclictest250538-21debian-sa107:15:011
249058993025,3cyclictest374121-21kworker/u8:11-rpciod12:07:560
249058993024,4cyclictest252033-21cron07:20:010
249058993022,5cyclictest282070-21systemd-run09:00:010
249058993022,5cyclictest282070-21systemd-run09:00:010
249058993022,5cyclictest0-21swapper/008:11:150
249060992924,3cyclictest250518-21kworker/u8:1-xprtiod08:01:202
249060992922,4cyclictest405694-21ps12:01:312
249060992922,3cyclictest0-21swapper/211:51:112
24906099292,20cyclictest959-21mta-sts-daemon08:26:302
249060992919,7cyclictest276040-21munin-plugin-st08:40:012
249060992914,9cyclictest351ktimers/208:16:222
24905999294,18cyclictest346226-21ssh10:41:221
249059992923,3cyclictest0-21swapper/109:20:011
249059992921,5cyclictest261574-21fschecks_count07:51:181
249058992924,3cyclictest0-21swapper/008:55:010
249058992924,3cyclictest0-21swapper/008:55:010
249058992923,3cyclictest0-21swapper/009:50:010
249058992920,6cyclictest3645540-21cups-browsed11:34:410
249058992920,6cyclictest323567-21fschecks_count10:11:100
249058992919,7cyclictest0-21swapper/007:31:320
249058992916,10cyclictest0-21swapper/010:04:460
249060992820,5cyclictest277500-21unixbench_singl08:41:362
249059992823,2cyclictest0-21swapper/108:20:021
249058992821,5cyclictest151ktimers/008:41:310
249058992820,6cyclictest249067-21sh07:10:010
249058992819,7cyclictest262556-21sh07:55:020
249060992721,3cyclictest0-21swapper/210:41:322
249060992720,4cyclictest959-21mta-sts-daemon11:47:292
249059992720,4cyclictest261040-21cron07:50:011
249059992719,5cyclictest957-21mta-sts-daemon08:06:241
249059992719,5cyclictest0-21swapper/109:00:011
249059992719,5cyclictest0-21swapper/109:00:011
24905899273,19cyclictest427012-21ssh12:31:170
24905899273,19cyclictest427012-21ssh12:31:170
24905899272,22cyclictest12450irq/32-eth009:21:220
249058992721,4cyclictest425521-21cron12:30:010
249058992721,2cyclictest0-21swapper/009:31:130
249058992719,5cyclictest151ktimers/008:16:230
249058992716,8cyclictest0-21swapper/010:51:150
249058992716,8cyclictest0-21swapper/008:00:010
249060992619,4cyclictest264035-21sendmail08:00:012
249060992614,9cyclictest351ktimers/207:26:252
249060992614,9cyclictest351ktimers/207:26:252
249059992620,3cyclictest0-21swapper/108:00:011
249058992619,5cyclictest277780-21munin-node08:46:110
249058992615,8cyclictest3645540-21cups-browsed10:06:360
249058992615,8cyclictest3645540-21cups-browsed10:06:360
249060992518,4cyclictest278365-21needreboot08:46:192
249060992516,5cyclictest256540-21munin-plugin-st07:35:012
249059992516,6cyclictest410773-21munin-run12:10:021
249058992519,3cyclictest250518-21kworker/u8:1-xprtiod07:26:180
249058992519,3cyclictest250518-21kworker/u8:1-xprtiod07:26:180
249060992417,4cyclictest0-21swapper/211:27:032
249060992416,5cyclictest3645540-21cups-browsed08:20:072
249059992416,5cyclictest283814-21diskmemload09:27:071
249059992415,6cyclictest256478-21unixbench_singl07:31:321
249059992411,10cyclictest955-21mta-sts-daemon08:46:261
249058992417,3cyclictest0-21swapper/010:45:400
24906099236,8cyclictest36-21ksoftirqd/208:51:242
24906099236,8cyclictest36-21ksoftirqd/208:51:242
249059992317,3cyclictest0-21swapper/108:31:311
249058992316,4cyclictest270587-21cut08:21:140
249058992315,5cyclictest3645540-21cups-browsed07:12:510
249058992315,5cyclictest258041-21munin-run07:40:020
249060992215,4cyclictest252599-21fschecks_time07:21:252
24905999222,15cyclictest283013-21ntp_states09:01:261
24905999222,15cyclictest283013-21ntp_states09:01:261
249058992215,5cyclictest270875-21kworker/u8:0+nfsiod08:25:060
249058992214,5cyclictest957-21mta-sts-daemon08:35:010
249059992114,5cyclictest279066-21kworker/u8:1+events_unbound08:51:271
249059992114,5cyclictest279066-21kworker/u8:1+events_unbound08:51:271
24905899214,4cyclictest260086-21fschecks_time07:46:170
24906199203,10cyclictest0-21swapper/309:16:283
24906199192,9cyclictest0-21swapper/310:36:213
24906199192,9cyclictest0-21swapper/310:21:213
24906199192,8cyclictest0-21swapper/310:31:163
249060991914,2cyclictest0-21swapper/207:10:022
24906199182,9cyclictest0-21swapper/312:31:193
24906199182,9cyclictest0-21swapper/312:31:193
24906199181,10cyclictest0-21swapper/311:41:213
24906199181,10cyclictest0-21swapper/311:41:213
24906199173,7cyclictest0-21swapper/311:01:243
24906199173,7cyclictest0-21swapper/310:41:213
24906199172,9cyclictest0-21swapper/309:51:203
24906199172,8cyclictest0-21swapper/311:21:293
24906199172,8cyclictest0-21swapper/310:56:233
24906199172,8cyclictest0-21swapper/310:56:233
24906199172,8cyclictest0-21swapper/307:56:223
24906199172,10cyclictest0-21swapper/311:51:173
24906199172,10cyclictest0-21swapper/311:11:183
24906199171,10cyclictest0-21swapper/312:21:273
24906199163,8cyclictest0-21swapper/311:35:143
24906199162,8cyclictest0-21swapper/310:16:263
24906199162,7cyclictest0-21swapper/307:51:253
24906199161,9cyclictest0-21swapper/310:15:023
24906199161,9cyclictest0-21swapper/307:40:483
24906199161,8cyclictest0-21swapper/312:36:213
24906199161,10cyclictest0-21swapper/310:01:223
24906199160,6cyclictest0-21swapper/307:46:393
24906199154,8cyclictest0-21swapper/309:41:243
24906199154,6cyclictest0-21swapper/309:36:233
24906199153,8cyclictest0-21swapper/310:51:263
24906199153,7cyclictest0-21swapper/312:11:233
24906199152,8cyclictest0-21swapper/312:01:213
24906199152,8cyclictest0-21swapper/311:56:223
24906199152,8cyclictest0-21swapper/311:16:293
24906199152,7cyclictest0-21swapper/309:56:193
24906199151,9cyclictest0-21swapper/309:31:233
24906199143,6cyclictest0-21swapper/311:31:103
24906199142,8cyclictest0-21swapper/312:16:213
24906199142,8cyclictest0-21swapper/310:27:343
24906199142,8cyclictest0-21swapper/309:21:203
24906199142,8cyclictest0-21swapper/309:11:123
24906199141,7cyclictest0-21swapper/307:26:193
24906199141,7cyclictest0-21swapper/307:26:193
24906199141,6cyclictest0-21swapper/308:16:213
24906199141,6cyclictest0-21swapper/307:11:243
24906199133,6cyclictest0-21swapper/308:15:013
24906199133,5cyclictest0-21swapper/308:31:303
24906199131,8cyclictest0-21swapper/311:45:533
24906199131,7cyclictest0-21swapper/307:36:503
24906199131,6cyclictest0-21swapper/308:36:233
24906199131,6cyclictest0-21swapper/307:16:263
24906199124,5cyclictest0-21swapper/308:26:193
24906199122,7cyclictest0-21swapper/311:10:023
24906199122,6cyclictest0-21swapper/309:10:013
24906199121,8cyclictest0-21swapper/312:29:063
24906199121,8cyclictest0-21swapper/310:46:563
24906199121,7cyclictest0-21swapper/311:30:023
24906199121,7cyclictest0-21swapper/308:56:273
24906199121,7cyclictest0-21swapper/308:56:273
24906199121,6cyclictest0-21swapper/307:31:213
24906199121,6cyclictest0-21swapper/307:21:353
24906199112,6cyclictest0-21swapper/310:10:023
24906199112,6cyclictest0-21swapper/310:10:023
24906199112,6cyclictest0-21swapper/309:45:263
24906199111,6cyclictest0-21swapper/308:51:303
24906199111,6cyclictest0-21swapper/308:51:303
24906199111,6cyclictest0-21swapper/308:41:233
24906199111,6cyclictest0-21swapper/308:06:203
24906199102,6cyclictest0-21swapper/309:26:433
24906199102,5cyclictest0-21swapper/308:46:243
24906199101,6cyclictest0-21swapper/309:01:243
24906199101,6cyclictest0-21swapper/309:01:243
24906199101,6cyclictest0-21swapper/308:21:213
24906199101,5cyclictest0-21swapper/312:10:033
2490619990,5cyclictest0-21swapper/308:01:163
2490619981,5cyclictest0-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional