You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-19 - 10:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot3.osadl.org (updated Wed Nov 19, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2397757991411,1cyclictest0-21swapper/320:35:143
239775799140,11cyclictest0-21swapper/323:10:213
239775799138,0cyclictest0-21swapper/319:15:143
239775799131,11cyclictest0-21swapper/322:00:173
239775799130,1cyclictest0-21swapper/320:00:173
239775799130,11cyclictest0-21swapper/321:00:133
239775799130,11cyclictest0-21swapper/319:50:143
239775799120,11cyclictest69450irq/121-eno121:43:493
239775799120,11cyclictest0-21swapper/323:45:133
239775799120,11cyclictest0-21swapper/323:25:013
239775799120,11cyclictest0-21swapper/320:45:143
239775799120,11cyclictest0-21swapper/320:05:133
239775799120,11cyclictest0-21swapper/300:40:023
239775799119,1cyclictest0-21swapper/320:30:133
239775799111,9cyclictest69450irq/121-eno122:40:153
2397757991111,0cyclictest0-21swapper/319:20:023
2397757991110,0cyclictest69450irq/121-eno100:05:223
2397757991110,0cyclictest0-21swapper/321:15:153
239775799110,10cyclictest69450irq/121-eno123:22:473
239775799110,10cyclictest0-21swapper/322:35:213
239775799110,10cyclictest0-21swapper/321:35:013
239775799110,10cyclictest0-21swapper/321:15:003
239775799110,10cyclictest0-21swapper/320:50:203
239775799110,10cyclictest0-21swapper/319:55:123
239775799110,0cyclictest0-21swapper/319:50:003
239775799110,0cyclictest0-21swapper/319:40:173
239775799110,0cyclictest0-21swapper/319:25:203
239775799109,0cyclictest0-21swapper/319:30:163
239775799108,1cyclictest0-21swapper/300:25:143
2397757991010,0cyclictest69450irq/121-eno122:55:153
2397757991010,0cyclictest69450irq/121-eno122:55:153
2397757991010,0cyclictest69450irq/121-eno122:10:193
2397757991010,0cyclictest69450irq/121-eno121:45:153
2397757991010,0cyclictest0-21swapper/323:55:023
2397757991010,0cyclictest0-21swapper/323:50:143
2397757991010,0cyclictest0-21swapper/321:52:533
2397757991010,0cyclictest0-21swapper/300:10:163
239775799100,9cyclictest69450irq/121-eno123:35:203
239775799100,9cyclictest69450irq/121-eno122:25:183
239775799100,9cyclictest0-21swapper/323:45:013
239775799100,9cyclictest0-21swapper/322:05:193
239775799100,0cyclictest0-21swapper/322:45:223
239775799100,0cyclictest0-21swapper/320:15:223
239775799100,0cyclictest0-21swapper/300:20:003
23977579999,0cyclictest69450irq/121-eno122:22:353
23977579999,0cyclictest69450irq/121-eno100:01:213
23977579998,1cyclictest69450irq/121-eno120:40:183
23977579998,0cyclictest0-21swapper/322:15:143
23977579990,8cyclictest69450irq/121-eno123:05:143
23977579990,8cyclictest0-21swapper/321:25:153
23977579990,8cyclictest0-21swapper/319:15:013
23977579990,0cyclictest0-21swapper/300:30:133
23977579988,0cyclictest69450irq/121-eno121:56:313
23977579987,0cyclictest0-21swapper/320:10:163
23977579980,7cyclictest69450irq/121-eno123:33:043
23977579980,7cyclictest69450irq/121-eno122:30:183
23977579980,7cyclictest69450irq/121-eno121:35:113
23977579980,7cyclictest69450irq/121-eno121:05:223
23977579980,7cyclictest0-21swapper/300:20:203
23977579980,0cyclictest0-21swapper/323:15:163
23977579977,0cyclictest69450irq/121-eno121:24:013
23977579966,0cyclictest69450irq/121-eno119:35:303
23977579960,5cyclictest0-21swapper/320:25:123
2397350261,4sleep30-21swapper/319:06:523
23977579955,0cyclictest69450irq/121-eno123:00:043
23977579955,0cyclictest69450irq/121-eno120:55:183
23977579955,0cyclictest0-21swapper/322:50:133
23977579950,4cyclictest69450irq/121-eno120:20:143
2474446240,3sleep12474570-21/usr/sbin/munin22:20:181
2398059240,3sleep02398324-21diskstats19:10:140
2397334242,1sleep20-21swapper/219:06:392
2397266242,1sleep10-21swapper/119:05:461
2482591230,1sleep02482617-21apt-get22:40:150
2396087231,0sleep00-21swapper/019:05:170
2527980220,1sleep22528136-21ntp_states00:25:192
2526239220,1sleep02526456-21sed00:20:210
2522900220,1sleep02523124-21latency_hist00:15:010
2517681220,1sleep00-21swapper/000:00:200
2494646220,0sleep00-21swapper/023:07:570
2494558220,0sleep20-21swapper/223:07:102
2489837220,1sleep22490133-21sed22:55:222
2489837220,1sleep22490133-21sed22:55:212
2486766220,1sleep22486792-21apt-get22:50:132
2479477220,1sleep00-21swapper/022:30:470
2471582220,1sleep02471773-21latency_hist22:15:010
2470721220,0sleep10-21swapper/122:10:221
2463204220,1sleep12463226-21munin-run21:55:011
2455840220,1sleep00-21swapper/021:35:180
2454600222,0sleep10-21swapper/121:31:351
2451186220,1sleep10-21swapper/121:25:151
2448917220,2sleep20-21swapper/221:19:552
2446302220,0sleep00-21swapper/021:11:060
2439614220,1sleep12439727-21grep20:55:181
2436323220,1sleep22436587-21unixbench_singl20:45:212
2428134220,1sleep20-21swapper/220:25:162
2416505220,1sleep12416659-21ntp_states19:55:171
2411462220,1sleep02411465-21sshd19:40:350
2532848210,0sleep00-21swapper/000:35:260
2532586210,0sleep20-21swapper/200:35:242
2531538210,0sleep10-21swapper/100:35:151
2530356210,0sleep10-21swapper/100:30:231
2530068210,0sleep20-21swapper/200:30:202
2529447210,0sleep00-21swapper/000:30:140
2527854210,0sleep10-21swapper/100:25:191
2527341210,0sleep00-21swapper/000:25:060
2525790210,0sleep10-21swapper/100:20:181
2523148210,0sleep10-21swapper/100:15:101
2523138210,0sleep00-21swapper/000:15:050
2522435210,0sleep20-21swapper/200:10:592
2521063210,0sleep10-21swapper/100:10:141
2519777210,0sleep00-21swapper/000:05:200
2519499210,0sleep20-21swapper/200:05:182
2518724210,0sleep10-21swapper/100:05:011
2516867210,0sleep20-21swapper/200:00:022
2516345210,0sleep10-21swapper/100:00:011
2514538210,0sleep10-21swapper/123:55:161
2514495210,1sleep00-21swapper/023:55:070
2513991210,0sleep20-21swapper/223:55:012
2513566210,0sleep00-21swapper/023:51:190
2512181210,0sleep20-21swapper/223:50:132
2512152210,0sleep10-21swapper/123:50:121
2510502210,0sleep20-21swapper/223:45:172
2510255210,0sleep10-21swapper/123:45:171
2510142210,0sleep00-21swapper/023:45:160
2508953210,0sleep00-21swapper/023:40:220
2508053210,0sleep20-21swapper/223:40:162
2507982210,0sleep10-21swapper/123:40:151
2506309210,0sleep10-21swapper/123:35:191
2505873210,0sleep20-21swapper/223:35:162
2505617210,0sleep00-21swapper/023:35:020
2505247210,0sleep10-21swapper/123:31:471
2504570210,0sleep20-21swapper/223:30:212
2503781210,0sleep00-21swapper/023:30:140
2502412210,0sleep20-21swapper/223:25:192
2501576210,0sleep10-21swapper/123:25:021
2501174210,0sleep00-21swapper/023:25:010
2500837210,0sleep20-21swapper/223:22:032
2500797210,1sleep12500801-21ssh23:21:421
2500210210,0sleep00-21swapper/023:20:220
2498629210,0sleep20-21swapper/223:16:152
2497322210,0sleep00-21swapper/023:15:170
2496974210,0sleep10-21swapper/123:15:021
2495596210,0sleep00-21swapper/023:10:240
2495244210,0sleep20-21swapper/223:10:222
2495149210,0sleep10-21swapper/123:10:211
2494024210,0sleep10-21swapper/123:05:221
2491357210,0sleep20-21swapper/223:00:182
2491091210,0sleep12491343-21cstates23:00:171
2490997210,0sleep00-21swapper/023:00:160
2489120210,0sleep10-21swapper/122:55:171
2489120210,0sleep10-21swapper/122:55:161
2488978210,0sleep00-21swapper/022:55:150
2488978210,0sleep00-21swapper/022:55:150
2488114210,0sleep0754-21snmpd22:50:430
2487189210,0sleep10-21swapper/122:50:161
2486418211,0sleep2451ktimers/222:49:132
2485104210,0sleep00-21swapper/022:45:200
2484681210,0sleep10-21swapper/122:45:161
2484203210,0sleep20-21swapper/222:43:052
2483212210,0sleep10-21swapper/122:40:201
2481549210,0sleep20-21swapper/222:35:362
2480250210,0sleep10-21swapper/122:35:151
2480219210,0sleep00-21swapper/022:35:140
2478682210,0sleep10-21swapper/122:30:191
2478222210,0sleep20-21swapper/222:30:162
2477441210,0sleep00-21swapper/022:26:140
2476224210,0sleep20-21swapper/222:25:162
2474571210,0sleep20-21swapper/222:20:192
2473673210,0sleep00-21swapper/022:20:010
2472634210,0sleep00-21swapper/022:15:210
2472354210,0sleep20-21swapper/222:15:202
2471834210,0sleep10-21swapper/122:15:151
2470278210,0sleep20-21swapper/222:10:192
2468556210,0sleep10-21swapper/122:05:211
2467786210,0sleep00-21swapper/022:05:160
2467661210,0sleep20-21swapper/222:05:142
2466363210,0sleep20-21swapper/222:00:232
2466075210,0sleep00-21swapper/022:00:200
2465637210,0sleep10-21swapper/122:00:171
2464262210,0sleep00-21swapper/021:55:200
2463903210,0sleep12463993-21kernelversion21:55:171
2463233210,0sleep20-21swapper/221:55:022
2461378210,0sleep00-21swapper/021:50:160
2461357210,0sleep20-21swapper/221:50:052
2459799210,0sleep02459998-21strings21:45:190
2459351210,0sleep10-21swapper/121:45:161
2459033210,0sleep20-21swapper/221:45:012
2458736210,0sleep10-21swapper/121:42:241
2458730210,0sleep00-21swapper/021:42:190
2457647210,0sleep20-21swapper/221:40:172
2455612210,0sleep20-21swapper/221:35:162
2453812210,0sleep20-21swapper/221:30:202
2453193210,0sleep00-21swapper/021:30:140
2452147210,0sleep00-21swapper/021:25:220
2451215210,0sleep20-21swapper/221:25:162
2450688210,1sleep10-21swapper/121:22:311
2449361210,0sleep20-21swapper/221:20:152
2449196210,0sleep00-21swapper/021:20:130
2448121210,0sleep00-21swapper/021:15:210
2444964210,0sleep10-21swapper/121:10:151
2443172210,0sleep00-21swapper/021:05:170
2443018210,0sleep20-21swapper/221:05:152
2441163210,0sleep22441332-21/usr/sbin/munin21:00:142
2441104210,0sleep10-21swapper/121:00:131
2441103210,0sleep00-21swapper/021:00:120
2440458210,0sleep20-21swapper/220:55:232
2439435210,0sleep00-21swapper/020:55:160
2438222210,0sleep20-21swapper/220:50:222
2437299210,0sleep00-21swapper/020:50:160
2437009210,0sleep10-21swapper/120:50:011
2435580210,0sleep10-21swapper/120:45:161
2435406210,0sleep00-21swapper/020:45:150
2434414210,0sleep10-21swapper/120:40:241
2433630210,0sleep00-21swapper/020:40:190
2433051210,0sleep10-21swapper/120:38:361
2431866210,0sleep20-21swapper/220:35:172
2431502210,0sleep00-21swapper/020:35:150
2430972210,0sleep10-21swapper/120:31:281
2430018210,0sleep20-21swapper/220:30:162
2429645210,0sleep00-21swapper/020:30:150
2427793210,0sleep00-21swapper/020:25:140
2426288210,0sleep00-21swapper/020:20:180
2426023210,0sleep20-21swapper/220:20:162
2425850210,0sleep10-21swapper/120:20:151
2424592210,0sleep00-21swapper/020:15:210
2424192210,0sleep10-21swapper/120:15:181
2423212210,0sleep00-21swapper/020:10:250
2422763210,0sleep10-21swapper/120:10:221
2420614210,0sleep10-21swapper/120:05:181
2420100210,0sleep20-21swapper/220:05:152
2419997210,0sleep00-21swapper/020:05:140
2418082210,0sleep20-21swapper/220:00:192
2417898210,0sleep10-21swapper/120:00:181
2417812210,0sleep00-21swapper/020:00:050
2416381210,0sleep00-21swapper/019:55:160
2416010210,0sleep20-21swapper/219:55:142
2414153210,0sleep00-21swapper/019:50:160
2413972210,0sleep20-21swapper/219:50:142
2413723210,0sleep10-21swapper/119:50:021
2412086210,0sleep00-21swapper/019:45:160
2411811210,0sleep10-21swapper/119:45:011
2410174210,0sleep20-21swapper/219:40:132
2410145210,0sleep10-21swapper/119:40:121
2408170210,0sleep20-21swapper/219:35:022
2406978210,0sleep20-21swapper/219:30:212
2406724210,0sleep00-21swapper/019:30:190
2406299210,0sleep10-21swapper/119:30:161
2405161210,0sleep10-21swapper/119:25:191
2405029210,0sleep00-21swapper/019:25:190
2403181210,0sleep10-21swapper/119:20:191
2402624210,0sleep20-21swapper/219:20:162
2402455210,0sleep00-21swapper/019:20:020
2401931210,0sleep20-21swapper/219:19:562
2399594210,0sleep00-21swapper/019:15:020
2398325210,0sleep10-21swapper/119:10:151
2397893210,0sleep20-21swapper/219:10:112
2525248200,0sleep20-21swapper/200:20:032
2523135200,0sleep20-21swapper/200:15:032
2476018200,0sleep10-21swapper/122:25:031
2455173200,0sleep10-21swapper/121:35:041
2447165200,0sleep10-21swapper/121:15:021
2444918200,0sleep20-21swapper/221:10:032
2442972200,0sleep10-21swapper/121:05:011
2433163200,0sleep20-21swapper/220:40:022
2427659200,0sleep10-21swapper/120:25:031
2423810200,0sleep20-21swapper/220:15:042
2421896200,0sleep20-21swapper/220:10:032
2412044200,0sleep20-21swapper/219:45:022
2408199200,0sleep10-21swapper/119:35:041
2408198200,0sleep00-21swapper/019:35:030
2404371200,0sleep20-21swapper/219:25:042
2400259200,0sleep10-21swapper/119:15:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional