You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-20 - 15:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Apr 20, 2024 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23154993029,1cyclictest0-21swapper/219:11:202
2315499270,1cyclictest19039-21diskmemload00:17:042
23153992727,0cyclictest0-21swapper/119:11:201
23149992726,1cyclictest24247-21lspci19:11:210
23154992623,3cyclictest0-21swapper/221:59:592
2315499260,2cyclictest17989-21awk23:55:002
2315499260,25cyclictest0-21swapper/221:37:022
2315499260,22cyclictest0-21swapper/221:51:172
2315499260,0cyclictest19039-21diskmemload23:55:142
2315499260,0cyclictest0-21swapper/223:33:042
2315499260,0cyclictest0-21swapper/222:57:392
2315499260,0cyclictest0-21swapper/222:12:022
2315499260,0cyclictest0-21swapper/200:21:272
23155992523,1cyclictest0-21swapper/322:32:073
2315599250,24cyclictest26813-21apt-get19:15:003
23154992522,3cyclictest0-21swapper/223:28:462
23154992521,3cyclictest19039-21diskmemload21:46:502
2315499250,24cyclictest0-21swapper/221:18:452
2315499250,24cyclictest0-21swapper/200:26:172
2315499250,22cyclictest19039-21diskmemload21:24:362
2315499250,21cyclictest0-21swapper/223:37:032
2315499250,1cyclictest19039-21diskmemload00:30:312
2315499250,1cyclictest0-21swapper/222:03:452
2315499250,1cyclictest0-21swapper/200:07:442
2315499250,0cyclictest19039-21diskmemload23:01:552
2315499250,0cyclictest0-21swapper/221:33:202
23153992523,1cyclictest0-21swapper/121:27:051
2315399250,24cyclictest19039-21diskmemload22:43:411
2315399250,24cyclictest0-21swapper/100:25:001
23155992423,1cyclictest19039-21diskmemload00:19:003
2315599240,23cyclictest0-21swapper/323:48:233
2315599240,1cyclictest30538-21ssh21:21:083
23154992422,2cyclictest0-21swapper/222:53:042
23154992421,2cyclictest18640-21systemd-journal20:45:002
23154992420,3cyclictest0-21swapper/223:41:592
2315499240,23cyclictest0-21swapper/221:11:302
2315499240,21cyclictest0-21swapper/221:27:372
2315499240,1cyclictest0-21swapper/222:39:112
2315499240,0cyclictest0-21swapper/221:41:282
23153992423,0cyclictest0-21swapper/121:53:211
2315399240,24cyclictest0-21swapper/100:27:061
2315399240,23cyclictest0-21swapper/123:27:431
2315399240,23cyclictest0-21swapper/122:10:541
2315399240,23cyclictest0-21swapper/100:06:381
2315399240,0cyclictest0-21swapper/123:38:291
2315399240,0cyclictest0-21swapper/121:46:161
2314999240,24cyclictest19039-21diskmemload21:15:570
2314999240,24cyclictest0-21swapper/023:34:040
2314999240,23cyclictest19039-21diskmemload00:14:590
2314999240,0cyclictest19039-21diskmemload21:56:260
23155992323,0cyclictest0-21swapper/322:38:103
23155992323,0cyclictest0-21swapper/321:55:383
23155992323,0cyclictest0-21swapper/321:32:523
23155992323,0cyclictest0-21swapper/321:11:293
23155992322,1cyclictest11816-21memory00:22:113
23155992321,1cyclictest19039-21diskmemload00:27:063
2315599230,23cyclictest19039-21diskmemload22:54:013
2315599230,23cyclictest0-21swapper/323:51:283
2315599230,23cyclictest0-21swapper/323:12:373
2315599230,23cyclictest0-21swapper/322:15:563
2315599230,23cyclictest0-21swapper/321:48:423
2315599230,23cyclictest0-21swapper/321:41:173
2315599230,22cyclictest22102-21sh23:25:013
2315599230,22cyclictest1-21systemd23:20:003
2315599230,22cyclictest10243-21ssh22:04:013
2315599230,1cyclictest0-21swapper/321:17:233
2315599230,0cyclictest19039-21diskmemload21:50:343
2315599230,0cyclictest0-21swapper/323:41:233
2315599230,0cyclictest0-21swapper/322:06:413
2315599230,0cyclictest0-21swapper/321:26:243
2315599230,0cyclictest0-21swapper/300:01:233
23154992323,0cyclictest0-21swapper/222:34:092
23154992322,1cyclictest19039-21diskmemload23:15:212
23154992322,1cyclictest19039-21diskmemload00:13:282
2315499230,2cyclictest618-21gdbus19:30:002
2315499230,23cyclictest0-21swapper/222:47:552
2315499230,23cyclictest0-21swapper/222:18:482
2315499230,22cyclictest11734-21apt-get22:40:022
2315499230,22cyclictest0-21swapper/223:50:002
2315499230,21cyclictest19039-21diskmemload22:26:102
2315499230,0cyclictest0-21swapper/223:24:032
2315499230,0cyclictest0-21swapper/223:06:412
2315499230,0cyclictest0-21swapper/219:17:032
2315499230,0cyclictest0-21swapper/200:02:582
23153992323,0cyclictest0-21swapper/123:55:281
23153992323,0cyclictest0-21swapper/123:45:321
23153992323,0cyclictest0-21swapper/123:43:351
23153992323,0cyclictest0-21swapper/123:10:111
23153992323,0cyclictest0-21swapper/122:49:161
23153992323,0cyclictest0-21swapper/122:33:481
23153992323,0cyclictest0-21swapper/122:05:321
23153992323,0cyclictest0-21swapper/121:43:171
23153992322,1cyclictest19039-21diskmemload21:22:151
2315399231,21cyclictest7755-21apt-get22:37:021
2315399230,23cyclictest19039-21diskmemload22:18:461
2315399230,23cyclictest0-21swapper/122:29:171
2315399230,23cyclictest0-21swapper/100:31:051
2315399230,22cyclictest32159-21apt-get00:10:011
2315399230,22cyclictest30160-21apt-get23:00:021
2315399230,22cyclictest27477-21latency_hist00:05:001
2315399230,22cyclictest22954-21sh21:12:581
2315399230,22cyclictest19060-21grep21:10:001
2315399230,1cyclictest6105-21munin-run22:00:001
2315399230,0cyclictest19039-21diskmemload00:15:501
2315399230,0cyclictest0-21swapper/123:54:211
2315399230,0cyclictest0-21swapper/123:23:311
2315399230,0cyclictest0-21swapper/121:36:071
23149992323,0cyclictest2662-21apt-get20:37:120
23149992323,0cyclictest19039-21diskmemload21:36:330
23149992323,0cyclictest0-21swapper/023:57:210
23149992323,0cyclictest0-21swapper/023:06:240
23149992323,0cyclictest0-21swapper/022:53:070
23149992323,0cyclictest0-21swapper/021:20:540
23149992323,0cyclictest0-21swapper/000:18:170
23149992321,1cyclictest11080-21tr22:40:000
2314999230,23cyclictest19039-21diskmemload21:40:080
2314999230,23cyclictest0-21swapper/022:17:000
2314999230,23cyclictest0-21swapper/022:08:120
2314999230,23cyclictest0-21swapper/021:10:410
2314999230,23cyclictest0-21swapper/020:45:000
2314999230,23cyclictest0-21swapper/000:37:590
2314999230,22cyclictest23509-21ssh21:45:140
2314999230,22cyclictest19734-21ssh00:31:180
2314999230,22cyclictest19039-21diskmemload23:40:500
2314999230,22cyclictest19039-21diskmemload21:31:090
2314999230,22cyclictest0-21swapper/023:22:030
2314999230,1cyclictest19039-21diskmemload22:44:220
2314999230,1cyclictest10191-21ssh22:03:560
2314999230,0cyclictest19039-21diskmemload23:12:520
2314999230,0cyclictest19039-21diskmemload00:00:330
2314999230,0cyclictest0-21swapper/023:49:410
2314999230,0cyclictest0-21swapper/022:57:030
2314999230,0cyclictest0-21swapper/000:28:120
23155992222,0cyclictest19039-21diskmemload22:47:073
23155992222,0cyclictest19039-21diskmemload21:38:033
23155992222,0cyclictest0-21swapper/323:33:513
23155992222,0cyclictest0-21swapper/300:35:493
23155992219,2cyclictest31647-21ssh23:01:343
2315599220,22cyclictest0-21swapper/322:27:343
2315599220,21cyclictest19039-21diskmemload22:10:203
2315599220,21cyclictest0-21swapper/320:27:083
2315599220,21cyclictest0-21swapper/320:27:073
2315599220,21cyclictest0-21swapper/320:25:003
2315599220,0cyclictest0-21swapper/322:20:263
2315599220,0cyclictest0-21swapper/300:08:213
2315499220,22cyclictest0-21swapper/223:10:012
2315499220,22cyclictest0-21swapper/222:05:362
2315499220,21cyclictest27013-21cut20:20:002
2315499220,21cyclictest19798-21idleruntime-cro20:05:002
2315499220,1cyclictest1772-21sh20:35:002
2315499220,0cyclictest0-21swapper/222:20:262
2315499220,0cyclictest0-21swapper/200:39:172
23153992222,0cyclictest0-21swapper/123:30:151
23153992222,0cyclictest0-21swapper/122:50:261
23153992222,0cyclictest0-21swapper/122:04:231
23153992221,1cyclictest0-21swapper/121:31:301
23153992220,1cyclictest29635-21apt-get19:20:021
2315399220,21cyclictest0-21swapper/122:55:401
2315399220,21cyclictest0-21swapper/121:16:081
2315399220,21cyclictest0-21swapper/100:35:351
2315399220,1cyclictest0-21swapper/122:22:401
23149992222,0cyclictest0-21swapper/022:23:550
23149992222,0cyclictest0-21swapper/020:47:020
23149992222,0cyclictest0-21swapper/000:22:070
23149992221,1cyclictest0-21swapper/022:30:510
23149992221,0cyclictest0-21swapper/000:06:270
23149992220,1cyclictest17151-21sh23:20:000
2314999220,22cyclictest0-21swapper/022:48:020
2314999220,21cyclictest0-21swapper/023:00:020
2314999220,21cyclictest0-21swapper/021:50:040
2314999220,21cyclictest0-21swapper/019:47:040
2314999220,1cyclictest23924-21hddtemp_smartct23:27:080
2314999220,1cyclictest14960-21cstates23:52:040
23155992121,0cyclictest0-21swapper/323:05:023
23155992121,0cyclictest0-21swapper/322:40:543
23155992121,0cyclictest0-21swapper/320:52:023
23155992120,1cyclictest32211-21ssh23:35:403
23155992120,1cyclictest18513-21sh23:22:023
23155992120,1cyclictest0-21swapper/319:42:043
23155992120,1cyclictest0-21swapper/300:32:143
23155992119,1cyclictest24574-21latency_hist20:15:003
2315599210,21cyclictest0-21swapper/323:55:403
2315599210,21cyclictest0-21swapper/322:56:353
2315599210,21cyclictest0-21swapper/300:10:123
2315599210,20cyclictest12957-21apt-get19:52:023
2315599210,20cyclictest0-21swapper/320:45:003
2315599210,0cyclictest0-21swapper/320:57:013
2315499210,20cyclictest0-21swapper/220:52:032
2315499210,20cyclictest0-21swapper/220:07:002
2315499210,0cyclictest0-21swapper/220:22:042
2315499210,0cyclictest0-21swapper/219:22:042
23153992121,0cyclictest0-21swapper/123:17:131
23153992119,1cyclictest4622-21idleruntime-cro20:40:001
2315399210,21cyclictest0-21swapper/123:05:321
2315399210,20cyclictest9863-21apt-get20:52:041
2315399210,20cyclictest27419-21apt-get20:22:041
2315399210,20cyclictest0-21swapper/121:02:031
2315399210,0cyclictest0-21swapper/120:07:001
23149992121,0cyclictest0-21swapper/022:25:130
23149992120,1cyclictest15800-21ssh22:10:140
23149992119,1cyclictest29407-21latency_hist20:25:000
2314999210,21cyclictest0-21swapper/023:35:020
2314999210,0cyclictest0-21swapper/020:02:050
23154992020,0cyclictest0-21swapper/219:32:082
2315499200,1cyclictest0-21swapper/221:02:162
2315499200,0cyclictest0-21swapper/220:12:052
2315499200,0cyclictest0-21swapper/219:52:022
23153992020,0cyclictest0-21swapper/120:17:051
23153992020,0cyclictest0-21swapper/119:47:031
23153992018,1cyclictest4876-21turbostat19:35:001
23149992020,0cyclictest12161-21apt-get19:50:020
23149992020,0cyclictest0-21swapper/021:02:030
23149992020,0cyclictest0-21swapper/019:57:050
2314999200,0cyclictest2889-21apt-get19:32:070
2314999200,0cyclictest0-21swapper/020:32:040
2314999200,0cyclictest0-21swapper/019:42:030
23155991919,0cyclictest26813-21apt-get19:15:013
23155991919,0cyclictest0-21swapper/319:27:033
23155991919,0cyclictest0-21swapper/319:22:033
23155991918,1cyclictest14679-21apt-get21:02:033
23155991918,1cyclictest0-21swapper/319:32:063
2315499192,16cyclictest30320-21cut20:27:112
2315499192,16cyclictest30320-21cut20:27:112
23154991918,0cyclictest0-21swapper/220:47:022
23154991917,1cyclictest7332-21awk19:40:002
23153991919,0cyclictest7467-21apt-get20:47:021
23153991919,0cyclictest22597-21apt-get20:12:041
23153991919,0cyclictest0-21swapper/120:57:011
23153991919,0cyclictest0-21swapper/120:35:001
23153991919,0cyclictest0-21swapper/119:52:021
23153991917,1cyclictest2428-21awk19:30:001
23153991917,1cyclictest17395-21awk19:59:591
23149991919,0cyclictest0-21swapper/020:57:010
23149991918,0cyclictest0-21swapper/020:27:070
23149991918,0cyclictest0-21swapper/020:27:070
23149991916,2cyclictest597-21dbus-daemon19:30:000
2315599180,0cyclictest0-21swapper/321:07:023
23154991818,0cyclictest0-21swapper/221:07:022
23154991816,1cyclictest597-21dbus-daemon19:50:002
2315499181,16cyclictest8656-21grep19:42:092
2315499180,17cyclictest13279-21awk20:57:082
23153991818,0cyclictest5084-21apt-get20:42:141
23153991818,0cyclictest0-21swapper/119:17:031
23149991818,0cyclictest0-21swapper/020:52:020
23149991815,2cyclictest24575-21cron20:15:000
23155991717,0cyclictest0-21swapper/320:32:043
23153991716,0cyclictest0-21swapper/120:02:051
2315499160,15cyclictest0-21swapper/219:57:122
23153991615,0cyclictest0-21swapper/119:37:011
23149991616,0cyclictest30453-21apt-get19:22:030
23149991616,0cyclictest0-21swapper/021:07:020
23149991615,0cyclictest27445-21apt-get19:15:010
23155991515,0cyclictest0-21swapper/319:37:013
2315599150,9cyclictest22054-21sshd20:08:453
23153991514,1cyclictest0-21swapper/120:29:471
23153991514,1cyclictest0-21swapper/120:29:471
2314999150,1cyclictest7521-21cat19:40:000
23155991414,0cyclictest2410-21apt-get20:35:023
2315599140,14cyclictest0-21swapper/320:45:243
2315599140,14cyclictest0-21swapper/320:01:303
2315599140,0cyclictest0-21swapper/320:15:403
2315599140,0cyclictest0-21swapper/319:55:143
23153991414,0cyclictest0-21swapper/119:40:021
23149991414,0cyclictest0-21swapper/020:15:300
23149991414,0cyclictest0-21swapper/020:05:330
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional