You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-29 - 09:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Thu Feb 29, 2024 00:44:10)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2318091995450,1cyclictest0-21swapper/321:15:303
2318091994240,0cyclictest0-21swapper/321:45:003
2318091993936,1cyclictest0-21swapper/322:35:323
2318091993834,1cyclictest0-21swapper/322:10:013
2318091993432,1cyclictest0-21swapper/323:20:213
2318091993432,0cyclictest0-21swapper/322:40:243
2318091993431,1cyclictest0-21swapper/321:35:263
2318091993331,0cyclictest0-21swapper/322:25:323
2318091993331,0cyclictest0-21swapper/319:20:243
2318091993230,0cyclictest0-21swapper/321:10:263
2318091993229,1cyclictest0-21swapper/300:25:023
24727312300,1chrt2472736-21gltestperf21:15:230
2318091993028,0cyclictest0-21swapper/300:00:243
2318091993027,1cyclictest0-21swapper/322:50:333
2318091993027,1cyclictest0-21swapper/322:00:223
2318091993026,1cyclictest0-21swapper/323:25:543
23410192290,1chrt0-21swapper/219:25:272
23410192290,1chrt0-21swapper/219:25:262
2318091992927,0cyclictest0-21swapper/320:25:273
2318091992926,1cyclictest0-21swapper/319:25:223
2318091992926,1cyclictest0-21swapper/319:25:213
2318091992926,1cyclictest0-21swapper/300:05:263
2318091992826,0cyclictest0-21swapper/323:35:353
2318091992826,0cyclictest0-21swapper/323:30:353
2318091992825,1cyclictest0-21swapper/322:10:233
2318091992726,0cyclictest0-21swapper/322:20:233
2318091992725,0cyclictest0-21swapper/322:19:563
2318091992725,0cyclictest0-21swapper/300:23:573
2318091992725,0cyclictest0-21swapper/300:15:373
2318091992624,0cyclictest0-21swapper/321:59:243
2318091992624,0cyclictest0-21swapper/300:31:053
2318091992623,1cyclictest0-21swapper/321:29:573
2318091992523,0cyclictest0-21swapper/323:15:323
2318091992523,0cyclictest0-21swapper/322:30:253
2318091992522,1cyclictest0-21swapper/322:49:423
2318091992522,1cyclictest0-21swapper/321:05:243
2318091992422,0cyclictest0-21swapper/323:45:053
2318091992422,0cyclictest0-21swapper/320:10:193
2318091992421,1cyclictest0-21swapper/323:53:553
2318091992421,1cyclictest0-21swapper/321:31:143
2318091992421,1cyclictest0-21swapper/321:31:133
2318091992421,1cyclictest0-21swapper/319:35:303
2318091992321,0cyclictest0-21swapper/321:51:023
2318091992321,0cyclictest0-21swapper/321:20:273
2318091992320,1cyclictest0-21swapper/323:58:503
2318091992320,1cyclictest0-21swapper/323:06:383
2318091992320,1cyclictest0-21swapper/323:04:533
2318091992320,1cyclictest0-21swapper/320:35:243
2318091992220,0cyclictest0-21swapper/300:10:133
2318091992120,0cyclictest0-21swapper/323:10:343
2318091992119,0cyclictest0-21swapper/323:41:033
2318091992119,0cyclictest0-21swapper/321:45:493
2318091992118,1cyclictest0-21swapper/319:50:193
25269622200,5sleep02526966-21ssh21:51:310
2318091992018,0cyclictest0-21swapper/322:56:153
2318091992018,0cyclictest0-21swapper/320:18:563
2318091991918,0cyclictest0-21swapper/320:30:323
2318091991917,0cyclictest0-21swapper/320:50:233
2318091991917,0cyclictest0-21swapper/319:15:003
2318091991916,1cyclictest0-21swapper/319:55:283
2318091991816,0cyclictest0-21swapper/300:35:163
93698170,11rtkit-daemon1-21systemd23:39:182
2318091991614,0cyclictest0-21swapper/320:49:553
2318091991614,0cyclictest0-21swapper/320:00:393
93698150,3rtkit-daemon2625799-21/usr/sbin/munin23:05:322
2318091991513,0cyclictest0-21swapper/319:34:553
2318091991411,1cyclictest0-21swapper/319:40:033
2318091991410,1cyclictest0-21swapper/319:15:393
93698130,6rtkit-daemon2751468-21apt-get00:35:221
93698130,4rtkit-daemon1-21systemd00:06:131
93698130,3rtkit-daemon1-21systemd23:50:152
93698130,3rtkit-daemon1-21systemd23:46:402
93698130,3rtkit-daemon1-21systemd23:40:422
93698130,3rtkit-daemon1-21systemd21:35:581
93698130,3rtkit-daemon1-21systemd20:40:230
93698130,1rtkit-daemon0-21swapper/120:14:281
24409402132,6sleep22440973-21apt-get20:50:222
2318091991312,0cyclictest0-21swapper/320:55:393
2318091991310,1cyclictest0-21swapper/319:45:243
93698120,4rtkit-daemon374-21systemd-udevd19:25:371
93698120,4rtkit-daemon374-21systemd-udevd19:25:361
93698120,3rtkit-daemon478-21systemd-logind22:37:372
93698120,3rtkit-daemon478-21systemd-logind20:27:360
93698120,3rtkit-daemon1-21systemd23:51:501
93698120,3rtkit-daemon1-21systemd22:45:322
93698120,3rtkit-daemon1-21systemd22:20:562
93698120,3rtkit-daemon1-21systemd00:32:271
93698120,2rtkit-daemon1-21systemd23:19:112
93698120,2rtkit-daemon1-21systemd22:44:142
93698120,1rtkit-daemon0-21swapper/121:47:191
24232992121,4sleep02424023-21sed20:35:260
2318091991211,0cyclictest0-21swapper/321:00:343
23171302121,6sleep22317162-21ps19:05:322
93698110,3rtkit-daemon478-21systemd-logind20:47:360
93698110,3rtkit-daemon374-21systemd-udevd22:59:362
93698110,3rtkit-daemon374-21systemd-udevd21:11:360
93698110,3rtkit-daemon374-21systemd-udevd20:33:360
93698110,3rtkit-daemon1-21systemd21:50:251
93698110,3rtkit-daemon1-21systemd20:19:301
93698110,3rtkit-daemon1-21systemd19:20:411
93698110,3rtkit-daemon1-21systemd00:26:201
93698110,3rtkit-daemon1-21systemd00:11:411
93698110,2rtkit-daemon1-21systemd22:51:432
93698110,2rtkit-daemon1-21systemd22:31:362
93698110,2rtkit-daemon1-21systemd20:55:230
93698110,2rtkit-daemon1-21systemd20:50:340
93698110,2rtkit-daemon1-21systemd19:52:131
27306422113,4sleep22730675-21apt-get00:20:222
27302622111,7sleep22730266-21ssh00:19:532
23493222111,8sleep10-21swapper/119:30:311
23263272113,4sleep02326360-21apt-get19:15:230
93698100,5rtkit-daemon2700579-21sendmail-mta23:55:301
93698100,5rtkit-daemon2354135-21grep19:35:321
93698100,3rtkit-daemon374-21systemd-udevd23:27:362
93698100,1rtkit-daemon0-21swapper/021:25:510
24035632101,6sleep22403671-21/usr/sbin/munin20:15:282
231809199108,0cyclictest0-21swapper/320:20:013
231809199101,6cyclictest2434660-21turbostat20:45:003
9369890,4rtkit-daemon2531693-21cut21:55:271
2757215290,1sleep00-21swapper/000:36:340
2684107290,0sleep02686150-21kthreadcore23:45:300
2674350291,5sleep02674407-21lockfile-create23:40:000
2542169292,3sleep02542202-21apt-get22:05:220
2540240291,5sleep12540320-21/usr/sbin/munin22:00:351
2376960291,5sleep12378978-21cut19:55:271
23180919991,5cyclictest2386819-21taskset20:05:223
9369880,4rtkit-daemon537-21gmain21:01:440
9369880,4rtkit-daemon2324237-21munin-node22:12:131
9369880,4rtkit-daemon1-21systemd21:21:550
9369880,3rtkit-daemon480-21wpa_supplicant21:30:381
9369880,3rtkit-daemon480-21wpa_supplicant21:30:371
9369880,3rtkit-daemon2731049-21hddtemp_smartct00:20:251
9369880,3rtkit-daemon2646865-21ssh23:20:092
9369880,3rtkit-daemon2411132-21/usr/sbin/munin20:25:271
2750631281,4sleep22750635-21ssh00:33:042
2730047281,5sleep12730051-21ssh00:19:041
2583548281,5sleep02583552-21ssh22:34:360
2563148284,2sleep0171ktimers/022:20:210
2540166281,4sleep02540238-21ps22:00:340
2534518280,1sleep20-21swapper/221:58:422
2519877280,0sleep00-21swapper/021:46:110
2427740281,5sleep22422842-21/usr/sbin/munin20:35:312
2424024281,4sleep12424802-21grep20:35:271
2392960281,4sleep02393068-21perl20:10:210
2374398281,3sleep22374425-21munin-run19:55:002
2327688282,4sleep22329135-21kthreadcore19:15:302
2320467281,4sleep12322430-21cut19:10:281
23180919981,4cyclictest2318244-21chrt19:10:003
9369870,3rtkit-daemon944-21sendmail-mta22:25:442
9369870,3rtkit-daemon684-21snmpd23:00:472
9369870,3rtkit-daemon684-21snmpd21:05:010
9369870,3rtkit-daemon684-21snmpd20:07:191
9369870,3rtkit-daemon684-21snmpd00:01:221
9369870,3rtkit-daemon537-21gmain20:01:121
9369870,3rtkit-daemon469-21NetworkManager23:10:092
9369870,3rtkit-daemon355-21systemd-journal21:42:561
9369870,3rtkit-daemon2665571-21sed23:30:312
9369870,3rtkit-daemon2324237-21munin-node22:16:562
9369870,3rtkit-daemon2324237-21munin-node19:47:051
9369870,3rtkit-daemon1-21systemd22:13:462
9369870,3rtkit-daemon1-21systemd21:26:301
9369870,3rtkit-daemon1-21systemd19:05:251
9369870,2rtkit-daemon2326213-21fschecks_count19:15:021
2750689270,0sleep00-21swapper/000:33:190
2708925270,0sleep00-21swapper/000:04:170
2689520270,4sleep02690165-21cut23:50:260
2682042271,3sleep12682122-21ssh23:45:271
2674663270,0sleep10-21swapper/123:40:131
2667082270,2sleep00-21swapper/023:33:400
2643496271,3sleep02644710-21memory23:15:280
2640371271,3sleep12640916-21irqrtprio23:15:251
2637644271,3sleep12637700-21ntp_states23:10:351
2598427271,3sleep02599311-21irqstats22:45:260
2585355271,3sleep12586411-21grep22:35:251
2571429271,4sleep12572104-21kthreadcore22:25:271
2561803271,3sleep12561807-21ssh22:16:421
2561661271,4sleep02561665-21ssh22:16:050
2552949271,3sleep02553873-21memory22:10:270
2542581271,3sleep12542770-21sed22:05:271
2533192271,3sleep02533300-21python321:55:320
2513932271,3sleep22513962-21munin-run21:45:002
2466300270,0sleep22466825-21cut21:10:302
2404834271,3sleep12404867-21apt-get20:20:211
9369860,1rtkit-daemon0-21swapper/119:40:161
2737598261,2sleep20-21swapper/200:25:222
2702501261,2sleep20-21swapper/200:00:262
2674720261,2sleep00-21swapper/023:40:240
2652601260,3sleep02652607-21ssh23:21:240
2625839261,3sleep02625982-21df23:05:210
2592908261,3sleep12594874-21cut22:40:291
2592356261,3sleep02592907-21grep22:40:280
2582159261,2sleep10-21swapper/122:30:371
2506569261,2sleep00-21swapper/021:38:330
2501772260,4sleep22503599-21cut21:35:312
2493319261,2sleep20-21swapper/221:30:252
2493319261,2sleep20-21swapper/221:30:252
2486366260,3sleep22486516-21df21:25:212
2486010261,2sleep20-21swapper/221:25:002
2485845262,2sleep10-21swapper/121:24:201
2451868260,3sleep22451964-21grep20:55:362
2430267261,3sleep12431922-21tr20:40:271
2406227260,4sleep02408077-21grep20:20:280
2393220261,2sleep20-21swapper/220:10:242
2363053261,2sleep00-21swapper/019:45:290
2362379261,2sleep00-21swapper/019:45:000
2361449260,3sleep22361537-21ntp_states19:40:312
2350321260,0sleep20-21swapper/219:34:332
2346009261,2sleep00-21swapper/019:30:260
2343671260,4sleep02343832-21sed19:25:340
2343671260,4sleep02343832-21sed19:25:330
2335255261,3sleep02336993-21cat19:20:280
2323200260,3sleep02323236-21ntp_states19:10:310
2313608261,2sleep00-21swapper/019:05:270
2751435251,1sleep20-21swapper/200:35:212
2742476251,1sleep00-21swapper/000:25:320
2737033250,0sleep00-21swapper/000:24:120
2722353250,0sleep00-21swapper/000:11:220
2718354250,3sleep22720268-21cut00:10:312
2709098251,2sleep02709547-21cat00:05:000
2701864250,0sleep00-21swapper/023:59:030
2696825251,2sleep20-21swapper/223:55:252
2660808251,1sleep10-21swapper/123:30:241
2655607250,3sleep02657534-21cut23:25:290
2654131251,2sleep10-21swapper/123:25:261
2639082250,3sleep00-21swapper/023:14:070
2627178251,2sleep10-21swapper/123:05:261
2618431250,0sleep00-21swapper/022:59:520
2611753251,2sleep10-21swapper/122:55:201
2606213251,2sleep02606765-21kthreadcore22:50:300
2599312251,2sleep10-21swapper/122:45:271
2574762250,0sleep00-21swapper/022:25:300
2564486251,1sleep10-21swapper/122:20:261
2547459251,2sleep22547648-21sh22:05:372
2522153251,2sleep20-21swapper/221:50:262
2514737251,2sleep20-21swapper/221:45:242
2512830250,0sleep00-21swapper/021:40:450
2494693251,2sleep00-21swapper/021:30:320
2494693251,2sleep00-21swapper/021:30:310
2477520251,2sleep20-21swapper/221:15:342
2460345251,2sleep20-21swapper/221:05:282
2453379251,2sleep22453903-21irqcore21:00:282
2443136251,2sleep10-21swapper/120:50:301
2418186251,2sleep20-21swapper/220:30:262
2416862251,1sleep10-21swapper/120:30:211
2405234251,2sleep20-21swapper/220:20:252
2388143251,2sleep00-21swapper/020:05:290
2386783251,1sleep20-21swapper/220:05:222
2364015251,2sleep22365584-21cut19:45:312
2351996251,2sleep02353119-21cut19:35:320
2351030251,2sleep20-21swapper/219:35:292
2723698240,1sleep00-21swapper/000:15:230
2624506240,2sleep00-21swapper/023:01:250
2606768240,2sleep12608697-21kthreadcore22:50:311
2584470241,1sleep02585354-21irqstats22:35:230
2464725240,2sleep12465216-21gpgconf21:10:011
2459021241,1sleep10-21swapper/121:05:241
2452974240,1sleep10-21swapper/121:00:231
2448304240,2sleep12449952-21kthreadcore20:55:301
2435114240,1sleep10-21swapper/120:45:241
2403717240,1sleep00-21swapper/020:15:300
2383105240,2sleep02385145-21grep20:00:310
2380789240,1sleep20-21swapper/220:00:252
2370527240,2sleep02372491-21cut19:50:260
2337746240,2sleep2684-21snmpd19:20:502
2709674230,1sleep20-21swapper/200:05:202
2667722230,1sleep10-21swapper/123:35:131
2646705230,1sleep10-21swapper/123:20:011
2618766230,1sleep10-21swapper/123:00:101
2540321230,1sleep20-21swapper/222:00:352
2472333230,1sleep10-21swapper/121:15:171
2434909230,1sleep20-21swapper/220:45:212
2431923230,1sleep20-21swapper/220:40:292
2410800230,1sleep20-21swapper/220:25:062
2380371230,1sleep20-21swapper/219:58:582
2376027230,1sleep00-21swapper/019:55:260
2318554230,1sleep20-21swapper/219:10:252
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional